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ABSTRACT 

V 

Part  I  of  this  paper  deals  with  the  problem  of  designing  a  feedback 
control  for  a  linear  infinite  dimensional  system  in  such  a  way  that  a  given 
quadratic  cost  functional  is  minimized.  The  essential  feature  of  this  work  is 
that: 

a)  it  allows  for  unbounded  control  and  observation,  i.e.  boundary  control, 
point  observation,  input/output  delays^  and 

b)  the  general  theory  is  presented  in  such  a  way  that  it  applies  to  both 
parabolic  and  hyperbolic  JBES  as  well  as  retarded  and  neutral  -PBBfr. 

In  Part  II  the  paper  develops  a  state  space  approach  for  retarded  systems 
with  delays  in  both  input  and  output.  A  particular  emphasis  is  placed  on  the 
development  of  the  duality  theory  by  means  of  two  different  state  concepts. 

The  resulting  evolution  equations  fit  into  the  framework  of  Part  I. 


AMS(MOS)  Subject  Classification:  34K35,  93C20,  93C25,  93D15. 

Key  Words:  Linear  quadratic  optimal  control,  infinite  dimensional  Riccati 
equation,  unbounded  control  and  observation,  retarded  systems. 
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THE  LINEAR  QUADRATIC  OPTIMAL  CONTROL  PROBLEM  FOR  INFINITE 
DIMENSIONAL  SYSTEMS  WITH  UNBOUNDED  INPUT  AND  OUTPUT  OPERATORS 

A.  j.  Pritchard*  and  D.  Salamon** 


1. _ INTRODUCTION 


The  control  and  observation  processes  for  many  dynamical  systems  are 
often  severely  limited.  For  example  there  may  be  delays  in  the  control 
actuators  and  measurement  devices.  Also  for  systems  described  by  partial 
differential  equations  it  may  not  be  possible  to  influence  or  sense  the  state 
of  the  system  at  each  point  of  the  spatial  domain.  Instead  controls  and 
sensors  are  restricted  to  a  few  points  or  parts  of  boundaries.  Modelling 
such  limitations  results  in  unbounded  input  and  output  operators. 

In  the  first  part  of  this  paper  we  develop  a  general  theory  for  linear 
quadratic  control  which  allows  us  to  consider  such  operators.  We  then  show 
how  the  theory  applies  to  hyperbolic  and  parabolic  partial  differential 
equations  and  neutral  systems  with  output  delays. 

In  the  second  part  of  the  paper  we  develop  a  state  space  theory  for 
linear  functional  differential  equations  with  general  delays  in  the  state, 
inputs  and  outputs.  Then  we  show  how  the  results  of  the  general  theory  may 
be  applied  and  hence  solve  the  linear  quadratic  control  problem  for  such 


systems. 


2.  FINITE  TIME  CONTROL 


PART  I 


In  a  formal  sense  our  basic  model  is 

x(t)  »  Ax(t)  +  Bu(t),  x(t  )  -  x, 

o  o 

(2.1) 

y(t)  -  cx(t),  t#  s  t  j  tl# 


■  -’-  ion  For 

-ww.ouecsd 

•*  -  id  o*=  t  icn 
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where  u(»)  t  L2  (t^tjjU),  y(.)  «  L2(t  .t^Y),  U  and  Y  are  Hilbert 
apacea  and  A  ia  the  infinitesmal  generator  of  a  strongly  continuous 
semigroup  S(t)  on  a  Hilbert  space  H.  In  order  to  allow  for  possible  un- 
boundedness  of  the  operators  B  and  C,  we  assume  that  B  <  ^L(U,V), 

C  a  <£(W,Y)  where  U,V  are  Hilbert  spaces  such  that 

(2.2)  W  C  H  C  V 

with  continuous  dense  injections.  Of  course,  we  interpret  equation  (2.1) 
in  the  mild  form  which  means  that  its  solution  x(t)  ia  given  by  the  variation- 
of-conatanta  formula 

t 

(2.3)  x (t)  -  S(t-t  )x  ♦  S(t-o)Bu(o)do,  t  f  t  $  t, 

oo  J  o  1 

o 

In  order  to  make  this  formula  precise  and  to  allow  for  trajectories .in  all 
three  spaces  W,H,V  we  have  to  assume  that  S(t)  is  also  a  strongly 
continuous  semigroup  on  W  and  V  and  that  the  following  hypotheses  are 
satisfied. 

*1 

(HI)  There  exists  some  constant  b  >  o  such  that  S(t  -o)Bu(o)do  e  W 

Jco  1 

C1 

and  ||  I  S(t-o)Bu(o)do||  S  b  ||  u(*)|| 

jto  w  i2(to.ti;U) 

for  every  u(.)  t  ^(t^.tjjU). 

(H2)  There  exists  soots  constant  c  >  o  such  that 

||C S( — t  )  x||  S  c  ||  x  || 

°  2  V 

1  <Vei;Y) 

for  every  x  €  W. 
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Remark!  2. 1 

(i)  For  evary  x  fc  W  and  every  u(- )  6  L2 (t  ,t;U)  formula  (2.3)  defines 

o  o 

a  continuous  function  x(.)  with  values  in  W  and  the  output  function  y(»)  is 
continuous  with  values  in  Y.  Alternatively  if  x  A  H  (reap.  V),  then 

P 

2 

x(')  is  only  continuous  with  values  in  H  (resp.  V)  and  y(*)  4.  L  (to>t^;Y). 
Sometimes  we  will  regard  (2.3)  as  a  dynamical  system  on  the  state  space  V. 

(ii)  In  the  following  we  identify  the  Hilbert  spaces  H,U  and  Y  with  their 
duals.  Then  it  follows  from  (2.2)  by  duality  that 

.  *  * 

V  C  H  C  W 

with  continuous  dense  embeddings.  Moreover,  S*(t)  is  a  strongly  continuous 

*  * 

semigroup  on  all  three  spaces  V  ,H,W  . 

(iii)  The  dual  statements  of  (HI)  and  (H2)  are  the  following 
*  * 

(HI  )  For  every  x  C  V  the  following  inequality  holds 

IIbYUj-OxII  $  b  1 1 x  || 

L2(to,ti;U)  W* 

(H2  )  For  every  y(«)  £  L  (t^.t^jY]  we  have 

A  *  e 

S  (r-t  )C  y(T)di  ||  «  c  ||  y ( - ) || 

} *0  V*  L2[to.VY] 

(see  SALAMON  [40]).  • 

(iv)  The  expression  CS(t)x  only  makes  sense  when  x  t  W.  However,  if  (H2) 

is  satisfied,  then  for  any  x  ft  V  we  will  use  the  expression  CS(t)x, 

.  .  2 

tQ  S  t  s  t^,  to  denote  the  function  in  1.  (tQ,t^sY)  which  is  obtained  by 

2 

continuous  extension  of  the  operator  W  n  x  ■»  CS(*)x  t  L  (t  , t,;Y)  to  x  e  V. 

o  1 

In  the  same  manner  we  define  B*S*(t)x,  tQ  S  t  S  t^,  for  x  *  W*  when  (HI)  is 
satisfied.  In  particular,  the  expressions  CS(t)Bu  and  B*S*(t)C*y  have  a  well 
defined  meaning  as  functions  of  t  when  (HI)  and  (H2)are  satisfied. 


“  V  .  •  ; 

.  •-  . 
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Associated  with  the  control  system  (2.3)  is  ths  performance  index 


J(u)  •  <x(t.),  Cx(t  )> 

1  i  ViI* 

(II  C*(t) ||f  ♦  <u(t),Ru(t)>  J  dt 
x  C 

where  C  C  £(V,V*)  it  s  positive  semidefinite  operator  and  R  *  i  (U) 

satisfies 

<u,Ru>  i  1 1|  u  ||2 
V  0 


for  sona  £  >  o  and  every  u  t  U. 

Now  let  us  consider  system  (2.3)  with  the  feedback  control 
(2.3)  uy(t)  -  F(t)x(t),  to  i  t  t  tv 

where  F(t)  €.  £(V,U)  is  strongly  continuous  on  the  interval  (t  ,tj].  T^en  ve 
may  define  a  mild  evolution  operator  *p(t,s)  <  "/(V),  tQ  f  «  S  t  (  t^,  via 

(2.6)  «F(t,s)x  -  S(t-s)x  +  |  S(t-c)BF(c)®p (o.s)xdo 
(see  CURTAIN-PRITCHARD  [9]). 

Remarks  2.2 

(i)  It  follows  from  (2.6)  thattp(t,s)  satisfies  the  equation 

(2.7)  ♦y(t,s)x-x  -  |  ♦p(t,o)[A+BF(o)]xdo,  t#  «  s  <  t  (  tj 

for  every  x  fc  &  y(A)  (the  doaain  of  A  regarded  as  an  unbounded,  closed 
operator  on  V),  Equivalently  the  function  s  — »  4p(t,s)x  A  V  is 
continuously  differentiabls  on  the  interval  [to»t]  for  every  x  <  D  y(A) 

and  satisfies 
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i 


(2.8) 


3«_(t,a)x 

- ^ - -  -  «F(t,a)[A  ♦  BF(s)]x,  tQ  f  s  f  t  i  tj 

(•••  CURTAIN-PRITCHARD  [9]). 

(ii)  It  it  wall  known  that  th«  evolution  operator  satisfies  the  aquation 

(2.9)  •y(t,a)x  -  S(t-s)x  +  |  ♦p(t,o)BF(o)S(o-s)xdo 

for  t  (  •  i  t  (  t.  and  x  ft  V. 

O  1 

(saa  CURTAIN-PRITCHARD  [9]). 

(iii)  Often  we  will  consider  the  feedback  system  with  an  additional  forcing 
input  v(.)  so  that 

(2.10)  u(t)  -  F(t)x(t)  ♦  v(t) 

in  (2.3).  It  follows  easily  froa  (2.9)  that  -  for  this  control  function  -  the 
corresponding  solution  of  (2.3)  is  given  by 

(2.11)  x(t)  -  *F(t,to)x  ♦  [  ♦y(t,o)Bv(o)do,  to  f  t  {  tj. 

Jto 

(iv)  Using  (2.6)  it  is  easy  to  see  that  «F(t,s)  is  also  a  strongly 
continuous  evolution  operator  on  W  and  V  and  has  the  following  properties. 

(HI')  Thereexists  a  constant  b'  >  o  such  that 

||  |  ♦  (t,o)Bu<o)do||  }b'  ||  u(-)|| 

eo  W  L2(to,t;U) 

for  every  u(-)A  t2(t  ,tjS0)  and  every  t  ft 

(H2')  There  exists  a  constant  c'  >  o  such  that 
||C*  (.,a)x||  f  c'  ||  x  || 

^(s.tjjT)  V 

for  every  x  6  W  and  every  s  t  [tQ, t^ j . 


The  dual  properties  ere  the  following 


(HI'  )  The  inequality 

II  B%*fe*)x|J  <b'  ||  x  || 

t2(to,t50)  W* 

holds  for  every  x  6  V*  and  every  t  A  {t^.t^. 

(H2'*)  The  inequality 
*1 

II  ♦*(T,s)C*y(-r)dT||  i  c*  II  y <*> || 

F  v  t2(:..tx*T) 

holds  for  every  y(*)«  L*(t0»t^;¥)  and  every  s  a  [t^.tj]. 

Using  the  condition  (H2')  and  its  dual  we  can  define  a  strongly  continuous 
operator  Py(t)  €  )»  by 

Pp(t)x  -  ♦y(tl,t)CdF(tl,t)x 

(2.12)  tj 

♦  j  ♦*<T,t)[C*C+F*(T)RF(T)]*F(T,t)xdT 

for  t  f  t  S  t.  and  x  a  V.  Then  the  cost  of  the  feedback  control  (2.5) 

0  1 

corresponding  to  an  initial  state  xq  6  V  is  given  by 

(2.13)  J^)  -  <xo,PF(to)xo>  #  . 

V,V 

If  the  initial  state  is  in  H,  then  this  expression  can  be  interpreted  via  the 
inner  product  in  H. 

2 

A  formula  comparing  the  cost  of  an  arbitrary  control  u(*)  «  L  (tQ,t^;U) 
with  the  cost  of  the  feedback  control  (2.5)  will  play  an  important  role  in 

our  analysis.  In  the  proof  of  this  result  we  will  need  to  interchange  some 
integrals.  At  some  points  this  becomes  a  delicate  problem  since  we  will 
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have  Co  operate  with  terms  like  Ctp(t,s)B.  In  order  to  make  tha  results 


precise,  we  need  a  third  hypothesis. 

(H3)  Suppose  that 

Z  -  flv(A)  C  V 

with  a  continuous,  dense  embedding  where  the  Hilbert  space  Z  is 
endowed  with  the  graph  norm  of  A,  regarded  as  an  unbounded,  closed 
operator  on  V. 

This  assumption  is  not  very  restrictive.  It  is  satisfied  by  all  known 
examples  of  systems  which  satisfy  (HI)  and  (H2)  .if  the  spaces  W  and  V  are 
chosen  appropriately.  In  the  following  we  summarise  some  important  consequences 
of  (H3) . 

Remarks  2.3 

(i)  If  (H3)  is  satisfied,  then  A  can  be  regarded  as  a  bounded  operator 
from  Z  into  V.  Correspondingly  A*  becomes  a  bounded  operator  from  V*  into 
Z*.  On  the  other  hand  A  can  be  restricted  to  a  closed,  densely  defined 
operator  on  Z.  It's  adjoint  in  this  sense  coincides  with  the  above  operator 
A*:V*  -*  Z*  (SALAMON  [40,  Lemaa  1.3.2})  and  moreover 

$  (A*)  C  3  (A*)  -  V*. 

VT  Z* 

(ii)  It  is  a  well  known  fact  from  semigroup  theory  that 

t 

Tt  x  -  |  S(s)xds  4  $V(A)  -  Z 
1  o 

for  every  x  £.  V  and  every  t  i  o.  If  (H3)  is  satisfied  then  is  a  strongly 
continuous  family  of  bounded,  linear  operators  from  V  into  H.  tt  is  easy 
that  the  adjoint  operator  T  €.  i(W*,V*)  is  given  by 
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to  see 


c 

Tt*x  -  |  S*(s)xds  «r  £>^(4*)  C  V* 
for  x  4  W*  and  t  i  o. 

(iii)  if  (HI),  (H2)  and  (H3)  ara  aaeiafiad  than  the  following  aquation 
holda  for  avary  u  C  U  and  avary  t  $  e 

t  t 

cj  S(a)Buda  -  CT  Bu  -  |  CS(a)Buda. 

O  ' 0 

Thia  aaama  lika  a  trivial  fact,  howavar,  wa  wara  not  abla  to  aatabliah  thia 
identity  without  aaauming  (H3).  Nota  that  tha  LHS  of  tha  above  equation 
haa  to  be  interpreted  in  terna  of  (HI)  and  tha  RHS  in  terna  of  (H2).  For 
ettabliahing  the  equation  one  ouat  approximate  Bu  a  V  by  a  aequenee  of 
elements  in  U.  Then  tha  term  on  tha  LHS  will  not  converge  in  general  unleg* 
range  T£  C  W. 

Lemma  2.4 

Suppose  that  (HI),  (H2),  (H3)  are  aatiafied,  let  F(t)  €  d?(V,U), 

t  5  t  (  t, ,  be  strongly  continuous  and  let  *_(t,s)  <  i  (V)  t%  (W)  be 
O  1  t 

defined  by  (2.6).  Moreover,  let  u(«)  A'L2(t  ,t,;U)  and  y(*)  €  L2(t  ,t  ;U) 

O  1  O  1 

be  given.  Then 

Co  el  t 

(2.14)  |  |  <CAF(t,a)Bu(a),y(t)>ydt  da  -  j  <cj  #F(t,a)Bu(a)da,y(t)>ydt 

where  the  first  expression  must  be  interpreted  in  terms  of  (H2*)  and  the 
second  in  terms  of  (HI1). 

Front  Firat  note  that,  by  (2.6)  and  (HI), 

♦F(t,a)  -  S(t-a)  "i^.W). 


-  8  - 


H«nc«  it  is  enough  to  establish  the  desired  equation  with  #p(t,s)  replaced 
by  S(t-s). 

Secondly,  let  us  assume  that  u(-)  a  Cl(t  ,t,;U)  and  u(t  )  -  0.  Then 

0  1  o 

t 

x(t)  -  I  S(t-s)Bu(s)ds 

eo 

t  s 

■  I  I  S(t-s)Bu(o)dods 

w 


t  t 


•1,1 

t 

*  lt  V.*8 


S(t-s)Bu(o)dsdo 


Bu(o)do 


Analogously,  we  get 


f'1  .  ,*l 

*<•)  -  J  S*(t-s)C  y(t)dt*-j  T*T  iC*y(T)dT 


for  y(0  jt  C1(to,t1;Y)  with  y(tx)  -  0.  This  iaplies 


L 


<Cx(t),y (t)>^dt 


H  e 

■  I  <CT ,  *u(s),y(t)>  ds  dt 

Jc  Jt  x 

o  o 
el  el 

-  f  f  <u(s),B*T*  C*y(t)>  d 

.  C~*  u 

H 

•  I  <u(s),B*  I  T*  C*y(T+s)dT>  ds 

Jt  Jo  T  » 

o 

r*1  >“* 

•  -  <u(s),B*  T*C*J(tn)dT>  ds 

JC  >  T  0 


dt  ds 
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<u(a),8*a(s)^ds 


2 

Both  sides  of  this  equation  depend  continuously  on  u(*)  t  L  (to»t^;U)  and 
y(')  6  L2(t  ,  t,  ;Y).  Moreover 

O  1 

C1 

]  <u(s),B**(s)>  ds 

i  U 


<Bu(s),  I  S*(t-s)C*y (t)dt>  ds 

jt  J.  v,v* 


*1  *1 

<CS(t-s)Bu(s) ,y(t)>  dt  ds. 

*  V 

o 


This  proves  the  statement  of  the  leraaa.  20 

Now  we  are  in  the  position  to  prove  the  desired  comparison  formula  for  the 
feedback  control  (2.5). 


Lemma  2.5 

Suppose  that  (HI),  (H2),  (H3)  are  satisfied,  let  F(t)  €  £(V,U)  be 

strongly  continuous  on  the  interval  [t  ,t.]  and  let  P_(t)  e.  £(V,V*)  be 

0  1  r 

defined  by  (2.12)  and  (2.6).  Then  the  following  equation  holds  for  every 
x  €  v  and  every  u(*)  C  L2(t  ,t.;U) 

O  0  1 


J(u)  -  <x  ,P  (t  )x  > 

o  r  o  o  . 

W  \7* 


where  x(t),  t  i  t  J  t, ,  is  given  by  (2.3). 

O  1 
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Proof  We  give  a  proof  of  (2.15)  for  the  case  x^  £  W  and  u(»)  C  C(to»t^;U). 
Let  x(c)  be  the  mild  solution  of  (2.1)  given  by  (2.3)  and  define 
v(t)  ■  u(c)-F (t)x(c)  for  t  i  ty  Then,  by  Remark  2.2  (iii) 

t 

*(t)  -  |  ♦?(t-s)Bv(s)ds  -  x(t)-*.(t',t0)*0 


for  t 

o 


j  t  j  tj. 


v#(t)  - 


y#(t)  - 


Let  us  first  apply  Lemma  2.4  to  the  functions. 

!v(t),  to  f  t  {  s, 

0,  a  <  t  S  tx 

f  0,  to  S  t  <  a, 

\  C«F(t,s)Bv(s),  •  <  t  (  tj 


V 

and  integrate  over  s.  Then  we  get 


<COF(t,s)z(s),C*F(t,s)Bv(s)>dt]ds 


t 

<c|  ♦F(t,o)Bvi(o)do,y#(t)>dt]  ds 


(t,o)Bv#(o),y#(t)>dc  doj  da 


,  by  (2.14) 


t 


1 


a 


t 


1 


<C$  (t,o)Bv(o),C*_(t,a)Bv(s)>dt]do  da 
f  r 

i 

<C*F(t,o)Bv(o),CdF(t,a)Bv(s)>dt  ds]  do 
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rn^A'd*.  ..  ... 


t 

<C*f(c,o)Bv(o),C  J  ♦F(t,»)Bv(»)d*>dC  do 
*  o 


t 

<C#_(t#«)Bv(f),c|  ♦^(tfo)Bv(o)d*>dt  d» 


,  by  (2.T4) 


and  hence,  again  using  Leanta  2.4, 

‘l  C1 

2Re  J  J  <C4F(c,s)x(s),C4F(t,s)Bv(s)>dc  da 


Vi 


L I. 


-  2Ra  |  |  <C*^(t,to)xo,C4f(tts)Bv(s)>dt  da 


C1  *1  * 


♦  Re  |  -  j  <  C |  *F(t.o)Bv(o)do,C4F(t,a)Bv(a)>dt  da 

'o  *  Co 

t  tx  t 

♦  Re  |  |  <cj  «F(t,o)Bv(o)do,C*F(t,a)Bv(a)>dt  da 


eo  •  * 


1  «• 

2 Re  j  <C*F<t,to)xo,Cj  ♦F(t,a)Bv(a)da>dt 


*1  *1 


*  Ra 


|  |  <Cx(t),C*F(t,s)Bv(s)>dt  da 


t  'a 
o 


i 

-  2Re  |  <C4F(t,to)xo,C*(t)>dt 


,  by  (2.14) 


i 

L 


<Ca(e),Cz(t)>dc 


-J  l|Cx(t)||*  dc  -  J  ||C4(t,to)xo||J 


dC. 


,  by  (2.14) 
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Analogous  identities  can  be  derived  in  a  sore  straightforward  way  when 
C*C  4  £(V,V*)  is  replaced  by  C  (  £  (V,V*)  or  F*(t)RF(t)  C  £  (V,V*), 
respectively.  This  implies 


Jt  'V 


2  JU  ]  <Pv(s)x(t ) ,Bv(s)>ds 
t 

o 


i 

2Ra  |  <#p(t1,s)x(s),C*F(t1,s)Bv(s)>ds 


f'1 

♦  2  Re  I  1  <C«F(tfs)x(s)>C*F(tls)Bv(s)>dt  ds 

co  • 


*i 


u 


♦  2  Re  I  J  <F(t)SF(t,j)x(s),RF(t>»F(tf*)Bv(s)>dt  da 


-  <x(t1),Cx(t1)>  -  <*F(t1,to)xo,C*F(tl,to)xo> 


r'1  f'1 

♦  <Cx(t) , Cx(t)>dt  -  <C#  (t,t  )x  ,C#_(t,t  )x  >dt 

J  r  o  o  F  o  o 

co  o 

f‘>  ('> 

♦  <F(t)x(t),RF(t)x(t)>dt  -  <F (t)#_(t,t  )x  ,RF(t>*  (t,t  )x  >dt. 

9  J  p  fOO  WOO 

* 


i!  ' 


Mow  the  LHS  of  (2. IS)  equals 


for  x  6  W  and  t  ?  t  i  t,  where  S(s,t)  ■  it  the  evolution  operator 

oi  r 

defined  by  (2.6)  with  F(t)  “  -  R  lB*P(t)  £  £  (V,U).  Furthermore  there  ie  a 
unique  optimal  control  which  minimize*  the  performance  index  (2.4)  aubject 
to  (2.3).  This  optimal  control  ia  given  by  the  feedback  control  law 

(2.17)  u^t)  -  -  R-*B*P(t)x(t) 
and  the  optimal  cost  is 

(2.18)  ^(uj,)  -  <xo,P(to)xo>  . 

Proof.  Me  regard  equation  (2.16)  as  a  fixed  point  problem  which  ia  to  be 
solved  by  iteration.  Let  us  define  the  sequence  Pk(t)  &  £(V,V*)  recursively 
through 

P  (t)  -  0 
o 

Pk(t)  -  PF(c),  F(t)  -  -r'Vp^U) 

for  k«  M  and  t  S  t  i  t. 

o  l; 

.  where  Pp(t)  is  given  by  (2.12).  Let  us  also  define 
♦k(s,t)  -  «F(s,t),  F (t)  -  -  R_1B*Pk(t), 

so  thdt 

Pk+ltt)x  "  \<el’t,GWt)x 

(2.19)  t 

♦  J  ^(s.t)  [cVPj.(s)BR_lB*Pk(s)]  6k(.,t)*d. 

holds  for  tfl  t  t  (  and  x  (,  W.  Applying  Lemma  2.5  to  F(t)  -  -  R  lB*Pk_j(t) 
and  uk(t)  -  -  R"1B*Pk(t)x(t),  we  obtain 


-  15  - 


VwW 


J(uk> 


(2.20) 


<x  ,P.  (t  )x  > 
o  k  o  o 


r  1  * 

-  J  [fk(r)-Pk.l(t)]x(0>ai 


«  ViW 


for  k  4  IN  and  x  4  V.  Thu*  the  sequence  <x  ,P.  (t  )x  >  ,  k  «  IN,  ia 

O  O  K  o  o  ^ 

v.v 


monotonically  decreasing  and  positiva.  Hanca  P^(tQ)  converges  strongly  to 

a  non-negative,  salf  adjoint  oparator  P(tQ)  6  £  (V.V*)  (cf.  RATO  [  25  .  p.454. 

Theorem  3.3]).  The  same  conclusion  is  valid  for  every  t  4  [t  , t,]  since  t  5  t, 

O  1  o  * 

can  ba  chosen  arbitrarily. 

Moreover,  (2.20)  shows  chat  the  function*  Pk(t)x,  tQ  f  t  f  tj,  k  «  g)  ,  are 
uniformly  bounded  in  V*.  Hence  the  limit  function  P(t)x,  e  g  t  g  tj,  is 
strongly  measurable  in  V*  and  bounded.  Therefore  we  can  introduce  a  strongly 
continuous  evolution  operator  $(s,t)  ■  *F(s,t)  •  ^  (V)  which  is  defined  by 

(2.6)  with  F(t)  -  -R~lB*P(t). 


Our  next  step  is  to  prove  that  9k(s,t)x  c  V  converges  for  every  x  e  V 
to  t(s,t)x'  and  that  this  convergence  is  uniform  on  th*e  domsin  t  $  s  (  tj 
(t  fixed).  For  this  sake  let  us  consider  the  identity 


♦  (s,t)x  -  ♦k(s,t)x 

s 

-  |  S(s-T)BR“lB*(Pk(t)-P(T)]  ♦(T.t)xdt 

s 

-  |  S(s-T)BR_1B*Pk(T)[#(T,t)X-gk(T,t)x]dT 
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and  apply  Gronvall'a  leans.  Than  Cha  daairad  convarganca  of  ♦^(a,t)x 
follows  froa  che  poincvisa  strong  convarganca  of  P^(t)  to  P(t)  togathar 
with  tha  dominated  convarganca  theorem. 


As  a  consequence  of  this  convarganca  result  wa  obtain  a  unifora  bound 

on  ||  ♦.(s,t)||  .  and  thus  on  ||  #fe(s,  t>  ||  .  for  k  (  N  and  t  i  a  $  t.. 

*  I(V)  *  j[(W)  1 

This  allows  us  to  apply  tha  dominated  convergence  thaoraa  to  foraula  (2.19) 
and  hence  P(t)  satisfies  tha  integral  Riccati  equation  (2.16).  Finally,  it 
follows  easily  froa  (2.16)  together  with  the  strong  continuity  of  9(s,t)  in 
both  variables  and  in  both  spaces  V  and  W  that  the  operator  P(t)  4.  Si  (V,V*) 
is  strongly  continuous  on  tha  interval  [to,t^] .  Thus  wa  have  proved  tha 
existence  of  a  solution  to  (2.16). 


In  order  to  prove  the  uniqueness  for  tha  solution  of  (2.16)  together  with 
the  statements  on  the  optimal  control,  let  us  assume  that  P(t)  fc  $.  (V,V*)  is 
any  strongly  continuous,  non-negative  solution  of  (2.16).  Moreover,  let 

*0  &  V,  u(.)  g  L2(to,tl;0)  be  given,  let  x  (t)  *  V  be  the  corresponding 
solution  of  (2.1)  which  is  given  by  (2,3)  and  define  v(t)  •  u(t)  ♦  R-1B*P(t)x(t) 
tor  Cq  f  t  $  tj.  Then  it  follows  froa  Lemma  2.5  that 


t 


1 


(2.21)  J(u)  -  <x  ,P(t  )x  >  ♦  <v(t)  ,Rv(t  )>dt. 

o  o  o  Jt 

o 

Hence  the  optimal  control  is  unique  and  given  by  the  feedback  law  (2.17)  and 
the  optimal  cost  is  given  by  (2.18).  Moreover,  we  conclude  from  (2.21)  that 
<*0»p(t<})*0>  "  <xo,P(to)xo>  for  any  two  non-negative  solutions  P(t),£(t)  £  &.  (V,V 
of  (2.16)  and  any  xq€  V.  Sines  tQ  J  t^  can  be  chosen  arbitrarily,  this  proves 
the  uniqueness  of  the  solution  to  (2.16).  2Z23 


The  following  result  shows  that  the  integral  Riccati  equation  (2.16)  can  be 
converted  into  a  differential  Riccati  equation. 


Proposition  2.7 

Suppose  that  (HI),  (H2)  and  (H3)  art  aaeiafiad  and  lat  P(t)  t  J  (V,V*)  ba 
a  non-negative,  aalf  adjoint,  strongly  continuous  operator  on  the  interval 
[t  ,t,J.  Moreover,  lat  the  evolution  operator  6(s,t)  ■  ♦_(s,t)  c  J  (V)  ba 

O  1  f 

defined  by  (2.6)  with  F(t)  ■  -  R  lB*P(t).  Than  the  following  statements  are 
equivalent. 

(i)  Equation  (2.16)  holds  for  every  x  q  W  and  every  t  &  [to,tj]. 

(ii)  For  every  x  c  W  and  every  t  t  [t^.tj]  the  following  equation  holdi 

*1 

(2.22)  P(t)x  -  ♦*(tl,t)CS(tl-t)x  ♦  I  ♦*(s,t)C*CS(s-t)xda 

'  t 

(iii)  For  every  x  6  W  and  every  t  4  [t(j,t1]  the  following  equation  holda 

P (t)x  -  S*(t1-t)GS(tl*t)x 
*1 

(2.23)  ♦  S* (s-t) (C*C-P (s) BR*lB*P (s) J  S (s- 1) xds 


(iv)  For  every  x  €  Z  the  function  P(t)x  ,  t#  |  t  J  tj  ia  continuously 
differentiable  with  values  in  Z*  and  satisfies  the  differential  Riccati  equation 

(2.24;1)  A  p(t)x  ♦  A*P(t)x  ♦  P(t)Ax  -  P(t)BR~Vp(t)x  ♦  C*Cx  -  0 

(2.24;2)  P(tx)x  -  Gx 

Proof  The  equivalence  of  the  statenents  (i),  (ii)  and  (iii)  can  be  established 
in  a  straightforward  way  by  using  tha  formulas  (2.6)  and  (2.9).  We  will  only 
show  that  (i)  implies  (ii).  In  fact,  (i)  implies  that  tha  following  equation 
holds  for  every  x  £  W  and  every  t  £  [t  ,t,] 

O  1 


P(t)x  e 

1 

-  #*(t,,t)CS(t  -t)x  ♦  [  •*(*, t)C*CS (s-t)xds 

jt 

.  r‘‘ 

♦  ♦  (tj.OG  j  ♦(t1,T)BF(T)S(T-t)xdT 

A  *  t  • 

♦  I  0*(s,t)C*C  I  ♦(s,T)BF(x)S(T-t)xdTd« 

't  >t 

f'1  *,  * 

♦  1  *  (s,t)F  (s)RF (»)• (s, t)xds 


where  P(t)  -  -R  1B  P(t)  £  ^  (V,U)  for  t  ,<  tj  t  ,  The  last  three  tarns  on 

O  1 

tha  RHS  of  this  equation  cancel  out  since 

A  * 

j  ♦*<s,t)F*(s)RF<s)*<s,t)xds 


•*(s,t)F*(a)RF(s)S(s-t)xds 
t,  s 


j  I  ♦*(s,c)F*(s)RF(s)*(s,T)BF(T)S(t-t)xdTds 

Jt 


-I  .*(, 


tO{P(T)  [BF(T)S(T-t)x] 


t 

el 


-  J  **(s,T)F*(s)RF(s)«(s,T){BF(T)SCT-t)x]ds)dT 

'  T 

A 

--j  ♦*(T,t)**(tl,x)G«(t1,T)BF(T)S(T-t)xdT 

ei  eJ 

-  j  ♦*(T,t)|  •*(s,t)C*C*(s,T)BF(T)S(T-t)xdsdt 

T 
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Applying  Lemma  2.4  to  the  final  term,  we  obtain  the  desired  cancellation. 

Now  ve  prove  the  equivalence  of  the  statements  (iii)  and  (iv).  Mote  that 
the  equation 


<CS(t)z,CS(t)x>  -  <Cz,Cx> 

(2.26)  t 

“  |  [<CS(s)Az,S(s)x>  ♦  <CS (s) z , CS (s )Ax> ] ds 
o 

holds  for  all  x,z  t|)H(A>  and  every  t  S  0.  It  follows  from  (H3)  and  (H2)  that 
both  sides  of  this  equation  depend  continuously  on  x,z  6  Z  •  *)y(A)  C  W  and 
that  $  ^ (A)  C  t)  y(A)  C  Z.  Consequently  ^  y(A)  is  dense  in  Z  and  hence  (2.26) 
holds  for  all  x,z  6.  Z. 

From  (2.26)  we  see  that  the  function  <z,P(t)x>  -  defined  by  (2.23)  -  is 
continuously  differentiable  on  the  interval  Cc0>cil  for  all  x,z  fc  Z  and  satisfies 
the  equation 

4-  <*,P(t)x> 


-  <S(t1-t)Az,GS(tjL-t)x>  -  <S(tj-t)z, GS  (t1~t)Ax> 


-  <Cz,Cx>  ♦  <z,P(t)BR_1B*P(t)x> 


|  [<CS(s-t)Az,CS(s-t)x>  ♦  <CS(s-t)z,CS(s-t)Ax>]ds 


I. 


♦  I  <S(s-t)Az,P(s)BR~lB*P(s)S(s-t)x>ds 


•  {  <S(s-t)z,P(s)BR"1 


B  P(s)S(s-t)Ax>ds 


-  <A*,P(t)x>  “  <z,P(t)Ax> 

-  <Cz,Cx>  ♦  <a,P(t)BR_lB*P(t)x> 
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This  implies 


«s,P(c)x> 

z,z* 

*1 

-<s,Cx  ♦  I  [A*P(a)x*P(«)Ax-P(s)BR_18*P(a)x-M:*Cx]de>  # 

'  t  2  ,Z 

•o'4  hence  (2.24  ;1).  Thus  wa  hava  proved  that  (iii)  implies  (iv). 

Conversely,  1st  us  assume  that  P(t)  aacisfias  (2.24).  Than  tha  following 
equation  holds  for  ovary  x  &  Z  and  avory  t  t  ft  ,C.] 

O  1 

S*(t1-t)GS(tl-t)x  -  P(t)x 
C1 

-  |  —■  S*(a-t)P(a)S(a-t)xda 

-  S*(s-t)[P(s)+A*P(s)+P(s)A]S(s-t)xds 
*1 

-  f  S*(s-t)[C*C-P(s)BR~Vp(a)]S(s-t)xds 
1 1 

vt\ara  tha  intagral  has  co  ba  understood  in  tha  Hilbert  space  Z*  and  #(t)  is  the 
strong  darivativa  of  P(t),  t  (  t  |  tj  regarded  as  an  operator  in  i  (Z,Z*).  S3 


INFINITE  TIME  CONTROL 


In  this  section  we  consider  the  control  problem  of  minimizing  the  performance 


index 


(3.1) 


J(u) 


♦  <u(t)  ,Ru(t)>  ]dt 
D 


where  y(t)  is  again  tha  output  of  (2.1)  with  t  -  0,  i.a. 

o 

I 


(3.2) 


M 

.  t 


t 

y(t)  -  CS(c)x  ♦  C  f  S(t-s)Bu(s)ds,  t  i  0. 

0  Jo 

For  this  infinite  tine  problem  it  is  not  clear  chat  the  cost  will  be  finite 

2 

for  any  control  input  u( • )  £  L  (o,»;U).  So  we  add  this  as  another  hypothesis. 
(H4)  For  every  x  fe  V  there  exists  a  u  (•)  £  L^[o,«;Ul  such  that  J(u  )<*. 

O  X  X 

o  o 

He  will  derive  the  optimal  control  via  the  solution  of  an  algebraic  Riccati 
aquation  which  is  actually  the  stationary  version  of  (2.24).  For  this  sake  we 
consider  the  finite  time  control  problems  of  minimizing  the  cost  functionals. 

T 

(3.3)  JT(u)  ■  j  [||  y(t)  ||  Y  ♦  <u(t),Ru(t)>o]dt 

subject  to  the  constraint  (3.2).  The  corresponding  Riccati  operator  will  be 
denoted  by  PT(t)  d  £  (V,V*)  and  satisfies  the  equation 


(3.4)  PT(t)x 


-  |  S*(s-t)[C*C-PT(s)BR-lB*PT(s)]S(s-t)xds 


for  every  x  «.  H  and  every  t  «  [0,T] . 


3.1 


PT-a<C)  *  PT(t+a)»  Os  t  <  T  -  a 


Proof 


The  operator  P^(t+a)  satisfies  the  equation 


PT(t+a)x  -  |  S*(s-t-a)(C*C-PT(s)BR"1B*PT(s)]S(s-t-o)xds 


t+a 

T-a 


-  J  S*(s-t)[C*C-PT(s+B)BR_1B*PT(s+a)]S(s-t)xds 


for  x  £  W  and  Of  t  <  T  -  o.  Thus  the  statement  of  the  Lemma  follows  from 
the  equivalence  of  (2.16)  and  (2.23)  (Proposition  2.7)  together  with  the 
uniqueness  result  (Theorem  2.6).  lZZ2 

We  will  derive  the  solution  of  the  algebraic  Ricvti  equation  as  the  limit 
of  the  solutions  to  integral  Riccati  equations  as  T  goes  to  infinity.  For  this 
we  need  the  following  preliminary  result  which  is  a  special  case  of  Proposition 
2.7. 


Corollary  3.2 

Suppose  that  the  hypotheses  (HI),  (H2)  and  (H3)  are  satisfied  and  let 
F  4  f(V.V*)  be  a  non-negative,  self  adjoint  operator.  Moreover,  let 
Sp(t)  t  i(V)  n  if (W)  be  the  strongly  continuous  semigroup  which  is  generated 
by  A-BR  1B*P:  £)  y(A)  -»  V,  i.e.  Sp(t)  satisfies  the  equation 

(3.5)  Sp(t)x  -  S(t)x  -  j  S(t-s)BR"1B*PSp(s)xds 

'o 

for  x  £  V  and  t  i  o.  Then  the  following  statements  are  equivalent. 

(i)  For  every  x  £  W  and  every  t  i  o 


Px  -  S*(t)PS  (C)x 
P  P 

(3.6)  t 

♦  [  Sp(s)  [C*C+PBR_1B*P]  Sp(s)xds 

(ii)  For  every  x  41  W  and  every  t  i  o 

t 

(3.7)  Px  -  S*(t)PS(t)x  ♦  |  S*(s)C*CS(s)xds 

(iii)  For  every  x  €.  W  and  every  t  i  o 

Px  -  S*(t)PS(t)x 
t 

♦  f  S*(s)[C*C-PBR_lB*P]S(s)xds 

'  A 
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(iv)  For  every  x  £  Z  Che  following  equation  holds  in  Z* 

(3.9)  K* Px  ♦  PAx  -  PBR_1B*Px  +  C*Cx  -  0. 

Mow  we  ere  in  the  position  to  prove  the  main  result  of  this  section. 

Theorem  3.3 

Let  (HI),  (H2)  and  (H3)  be  satisfied.  Then  the  following  statements  hold. 

(i)  The  hypothesis  (H4)  is  satisfied  if  and  only  if  there  exists  a  non-negative 
self  adjoint  solution  F  €  f(V,V*)  of  (3.9). 

(ii)  If  (H4)  is  satisfied,  then  there  exists  a  unique  optimal  control 
2 

u  (*)  e  L  (o,«*;U)  which  is  given  by  the  feedback  law. 

P 

(3.10)  up(t)  -  -  R_1B*Px(t),  t*0, 

where  P  £  £  (V,V*)  is  the  (unique)  minimal  solution  of  (3.9).  Moreover,  the 
optimal  cost  is  given  by 

(3.11)  J(u  )  -  <x  ,Px  >. 

p  o  o 

(iii)  If  (H4)  is  satisfied,  then  the  minimal  solution  P  t  £(V,V*)  of  (3.9)  is 
strong  limit  of  PT(o)  €  £  (V,V*)  as  T  goes  to  infinity  where  PT(t)  is  defined 
by  (3.4). 

Proof 

First  recall  that  the  optimal  control  of  the  finite  time  problem  on  the 

interval  [0,T]  is  given  by  u^t)  *  R  1B*PT(t)x(t),  0  s  t  $  T,  and  the  optimal 

cost  by  J_(u_)  -  <x  ,P_(o)x  >  (Theorem  2.4).  So  (H4)  implies  that 
XT  OX  O 

<xo,PT(o)xo>  -  J^Uj)  S  JT(ux  )  $  J(ux  )<• 


and  thus  there  exists  a  limit  of  the  increasing  function  <xo,PT(o)x0>,T  j  0,  for 


1 

•very  x0  6  v*  Hence  there  exists  a  non-negative,  self  adjoint  operator 
P  *  f(V,V*)  which  is  the  strong  limit  of  P,p(o)  (KATO  [25,  p.454,  theorem  3.3]). 

By  Lema  3.1, 

(3.12)  Px  -  s-lim  PT(t)x  d  V* 

exists  uniformly  in  t  on  every  compact  time  interval.  Making  use  of  formula 
(3.4),  we  obtain 

Px  -  lim  PT(o)x 
T-**» 

T 

-  lim  I  S*(s)[C*C-P  (s)BR_1B*P  (s)]S(s)xds 
T~  J0 

T 

-  lim  S*(t)S*(s-t)[C*C-PT(s)BR~1B,‘p  (s)]S(s-t)S(t)xds 
T—  ’  t 

t 

S*(s)[C*C-PT(s)BR“1B*PT(s)]S(s)xds 
o 

-  lim  S*(t)P  (t)S(t)x 
T-*« 

t 

♦  S*(s)[C*C-PBR~1B*P]S(s)xds 

*  O 

-  S*(t)PS(t)x 

t 

♦  [  S*(s)[C*C-PBR‘1B*P]S(s)xds 

*  o 

and  hence  P  6  £ (V,V*)  is  a  solution  of  (3.6),  (3.7),  (3.8)  and  (3.9). 

Conversely,  let  Q  d  4J (V,V*)  be  any  non-negative  solution  of  (3.9)  and 
let  Ug(t)  •  -R  *B*Qx(t)  be  the  corresponding  feedback  control  law  with  the 


im  | 


lim 
T- 
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associated  closed  loop  semigroup  S^(t)  t  /  (V)  r>  ^  (W).  Then  Che  following 
inequality  holds  for  every  £  V 

<x  .Qx  > 
o  o 

»  lim  (  <S  (t)x  ,QS  (t)x  > 

.  Q  O  Q  O 


(3.13)  ♦  |  <S  (s)xo,  [C*C+QBR-1B*Q]S  (s)xo>ds) 

Jq  ^  ^ 

«• 

i  j  <  SQ(c)xo,  [C*OQBR-1B*Q]  SQ(s)xo>ds 


-  J(uQ) 

and  hence  (H4)  is  satisfied.  Moreover,  the  operator  P  £  £  (V,V*>  defined  by 
(3.12)  satisfies  the  inequality 


<*  .px  > 

o  o 


-  lim  <x„.pT(o)x  > 

S  lim  JT(u) 

T*Hi 

-  J(u) 

2 

for  every  admissible  control  u(*)  £  L  (o,“;U).  This  shows  that  P  is  the 
minimal  positive  semidefinite  solution  of  (3.6).  Finally,  taking  Q  *  P,  we 
conclude  that  the  unique  optimal  control  is  given  by  (3.10)  with  cost  (3.11).  E3 

Although  the  above  theorem  yields  a  solution  to  the  infinite  time  problem, 
in  a  sense  it  is  unsatisfactory.  This  is  because  we  are  not  sure  of  a  unique 
solution  to  the  algebraic  Riccati  equation  and  also  we  cannot  be  sure  that  the 
semigroup  S^(t)  is  exponentially  stable.  In  order  to  resolve  those  difficulties, 
we  need  another  hypothesis. 


(US)  If  x  €  V  and  u(*)  £  L^(o,«;U)  are  such  that  J(u)<  •,  then  x(*)  6  L*(o ,«;V)‘ 
o 

vhere  x(c),  t  i  o,  is  given  by  (2.3)  with  t  •  0. 

o 

Theorem  3.4 

Let  (HI),  (H2),  (H3)  and  (H5)  be  satisfied.  Then  the  algebraic  Riccati  equation 

(3.9)  has  at  most  one  non-negative,  self  adjoint  solution  P  €  £  (V,V*).  Moreover, 

if  P  is  such  a  solution,  Chen  the  closed  loop  semigroup  S  (t)  £  £  (V)  is 

P 

exponentially  stable. 

Proof 

If  P  £  £(V,V*)  is  a  positive  semidefinite  solution  of  (3.9),  then  the 

inequality  (3.13)  with  Q-P  shows  that  the  closed  loop  control  u  (t)m-R  *B*Px(t) 

P 

has  a  finite  cost  for  every  initial  state  x  C.  V.  By  hypothesis  (HS)  this  means 

o 

that 

«• 

f  II  Sp(t)x0H  2  dt  <  “ 

o  v 

for  every  xg  £  V.  Hence  it  follows  from  a  result  of  DATKO  [11]  that  the  semi¬ 
group  S^(t)  £  £  (V)  is  exponentially  stable  (see  also  CURTAIN-PRITCHARD  [9]). 

The  stability  of  S^(t)  shows  chat  we  have  equality  in  (3.13)  and  hence 

J(u  )  -  <x  ,P  x  > • 

p  0  0 

How  let  Q  €  £.  (V,V*)  be  another  non-negative  solution  of  (3.9)  and  let  us  apply 
Leona  2.5  to  the  performance  index 

JT  Q*u)  “  <X<T>*<?*<T>> 

T 

♦  I  til  y<t) II 2  ♦  <u(t),Ru(C)>]  dt 
•o  T 

as  well  as  Che  feedback  F(t)  5  -  R  *B*Q  and  tha  control  input  u  (t).  Then 

P 

Py(c)  5  Q  and  hence  the  inequality 
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<x  ,Px  > 
o  o 


-  J(up) 


■  lim 
T*« 


T,Q 


V 


“  lim  1<X  ,Qx  > 

_  o  o 

T 

♦  [  (t)»  [R"Vox(t)*u  (t)]>dt 

Jo  P  *  P 


*  <X„»Q*  > 

O  O 

holds  for  every  xq  fe  V.  Interchanging  the  roles  of  P  and  Q,  we  conclude  that 
P  -  Q.  2Z3 

Finally,  let  us  briefly  discuss  the  hypotheses  (H4)  and  (H5)  which  are 
chosen  in  a  general  sense  but  are  difficult  to  check  in  concrete  exangiles.  in 
most  cases  it  might  be  desirable  to  replace  them  by  stronger  assumptions  which 
are  easier  to  check. 


Remarks  3.5 

Let  (HI)  and  (H2)  be  satisfied. 

(i)  Suppose  that  system  (2.1)  is  stabilizable  in  the  sense  that  there  exists  a 
feedback  operator  F  C  £  (V, U)  such  chat  the  closed  loop  semigroup  Sf(t)  «.  ^  (V) 
defined  by 

t 

S?(t)x  -  S(t)x  ♦  |  S(t-s)BFSp(s)xds 

for  t  )  o  and  x  C  V  is  exponentially  stable.  Then  hypothesis  (HA)  is  satisfied. 


In  fact,  there  is  an  instant  T  >  o  and  a  constant  Cj  >  o  such  that  the 
inequalities 
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i 


11  S,<t>V(v)  *  l*  l,csr(,)xll_2 _  *  cT||  X  II 


hold  tor  every  x  4  W.  This  implies  that 

II  CS  <0*11  f  nis.(T)||k  IMI 

l2(o.-;Y)  k-o  F  *(V)  V 


for  x  C  W  and  banco  (H3)  is  satisfied. 


(ii)  Suppose  chat  system  (2.1)  ia  detachable  in  eha  sense  that  there  exists 
en  operator  K  4  «t(Y,V)  such  that  the  output  injection  semigroup  S^(t)  «  *  (V) 
defined  by 

SK(t)x  -  S(t)x  ♦  j  SK(t-s)KCS(s)xds 
o 

for  t  i  o  and  x  C  W  (see  SALAMON  [40  ,  theorem  1.3.9])  is  exponentially  stable. 
Then  hypothesis  (H5)  ia  satisfied. 

In  fact,  if  x(t)  4  V  is  defined  by 

t 

x(t)  -  S(t)x  I  S(t-s)Su(s)ds,  t  i  o, 

■'o 

end  y(t)  ”  Cx(t)  for  x C  V  and  u(*)  4  L2  (o,«;U),  then  it  is  easy  to  see 
u  loc 

that 

t 

X(t)  -  SK(Oxo  ♦  |  S^(t-s)  [Bu(s)-Ky  (s)]ds,  t  i  o 
o 

Hence  J(u)  <  •  implies  that  x(0  6  l2  (0,»;V). 


<iii)  U  CH4)  and  (H5)  are  satisfied,  then  system  (2.1)  is  stabilizable  in  the 
aense  of  (i).  (Theorem  3.3  and  Theorem  3.4). 

(iv)  For  finite  dimensional  systems  (H5)  is  equivalent  to  detectability  in  the 
sense  of  (ii).  It  seems  to  be  en  open  problem  whether  this  equivalence  extends 
to  the  infinite  dimensional  situation. 
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4.  EXAMPLES 


4.1  Neutral  systems  with  output  delays 

We  consider  the  linear  neutral  functional  differential  equation  (NFDE) 

(4.1)  ^  <x(t)-Mxt)  -  Lxt*Bou(t) 

y(t)  -  Cxt 

where  x(t)  t  (R.n,  u(t)  4  R.m,  y(t)  e  fit.P  and  x£  is  defined  by 
x^Ct)  -  x(t+r),  -h  i  t  S  o,  h  >  o.  Bq  is  an  nxm  matrix  and  L,  M,  C  are 
bounded  linear  functionals  from  £  ■  C[-h,o;  B\B]  into  (R,n  and  respectively 

These  can  be  represented  by  matrix-functions  n(t),  u(t),  y(t)  of  bounded 

variation  in  the  following  way 

o  o 

14  “  |  dn(r)4(T),  -  J  dv(T)4(r). 

-h  -h 

o 

C*  «  |  dy(T)4(T)  ,  $  6  {£  . 

-h 


In  order  to  guarantee  the  existence  and  uniqueness  of  solutions  of  (4.1)  we 
will  always  assume 

(4.2)  |i(o)  -  lim  p(r) 

Tto 

Moreover,  we  will  assume  at  some  places  that  Btn  is  of  the  special  form 

m  o 

(4.3)  M»  -  l  A_j#Hij)  ♦  J  A_jT)4(T)dT  ,  ♦ 

j-1  -h  } 

where  o  <  hj  <  h  ,  4. .  t  (R.nxa  for  j  6  J|4  ,  A^O)  £  Ll[-h,0; 

and 

l  II A  ||  <  -  . 

j-1 
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A  function  x(»)  C  L2  ISi.*')  is  said  to  be  a  solution  of  (4.1) 

l0C  2  .  . 

if  the  function  w(t)  -  x(t)  -  Mxt  is  absolutely  continuous  with  an  L  -  derivative 

on  every  compact  interval  [0,T] ,  T  >  0,  and  if  w(t)  ■  Lx£  +  hQu(t) 

for  almost  every  t  i  o.  It  is  well  known  (BURNS-HERDMAN-STECH  [7],  SALAMON 

[40])  that  equation  (4.1)  admits  a  unique  solution  x(t),  t  i  -h,  for  every 

input  u(.)£  (o,**;  and  every  initial  condition 

(4.4)  lim  x(t)  -  Mxfc  -  4°,  x(t)  -  41(t),  -h  i  t  <  o  , 
t+o 

where  4  ■  (4°,  4*)  &  M2  ■  8.n  x  L2(-h,o;  (R.n).  Moreover  it  has  been  shown 
in  [ 7  J »  [40]  Chat  the  evolution  of  the  state 

(4.5)  x (t)  -  (x(t)  -  Mxt,xt)  €  M2 

of  system  (4.1),  (4.4)  can  be  described  by  the  formula 

t 

(4.6)  x(t)  -  S(t)4  ♦  [  S(t-s)Bu(s)ds 

'  o 

where  B  €.  f  (RB,  M2)  maps  u  €  ft™  into  the  pair  Bu  •  (B  u,o)  and 

o 

«  2 

s(t)  (.  i(M  )  in  the  strongly  continuous  semigroup  generated  by  A,  where 
D(A)  -  (4  «  M2:  416Wl,Z,  4°  -  4l(0)-M4i) 

A4  -  0*\  i1) 

Here  W1,2  denotes  the  Sobolev  space  W*’2  (-h,o;  |fcn  )  . 

Obviously,  the  dense  subspace 

W  -  {  (4(o)  -  M4.  4):  4  «  W1,2}  -  0  (A) 
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,-w  M,'*’ 


norm-  it  invariant  under  S(t)  and  S(e)  can  be 


of  M2  -  endowed  with  the  W*’2 
reatricted  to  a  strongly  continuoua  semigroup  on  W. 

The  output  of  the  ays tern  (4.1)  may  be  described  through  the  operator 

o 

c  s  «  -*  IRJ\  C*  s  |  dy  (t )$^ (t)  ,  *  «  W. 

-h 


Remarks  4.1 

(i)  The  infinitesimal  generator  A  of  S(t)  can  be  interpreted  as  a  bounded 

2  2 

operator  from  W  into  M  .  By  duality,  M  can  be  regarded  as  a  dense  subspace 
of  W*  end  A*  extends  to  a  bounded  operator  from  M2  into  W*. 

(ii)  It  has  been  proved  in  BURNS-HERDMAN-STECH  [ 7 ]  and  SALAMON  [40]  that 

2 

system  (4.1)  satisfies  the  hypotheses  (HI)  and  (H2)  with  H  -  V  »  M  and  the 
2 

subspace  W  C  M  as  defined  above.  Hypothesis  (HI)  says  that  the  state 

x(T)  €  of  (4.1)  defined  by  (4.5)  is  in  W  for  every  input  u(-)  C  L2(o,T;  fi.”*) 

and  zero  initial  condition  and  chat  x(T)  4  W  depends  continuously  on 

u(')  4  L2[o,T;  t5^m] .  Hypothesis  (H2)  says  Chat  the  output  y(*)  of  the  free 

system  (4.1)  (i.e.  u(t)  =  0)  is  in  L2(o,T;  |£^)  and  depends  in  this  space 

,  2 
continuously  on  the  initial  state  ♦  4  M  . 

(iii)  If  M  :  ^  •*  (^n  is  given  by  (4.3),  then  it  is  known  that  the  semigroup 
S(t)  *  i(M2)  is  exponentially  stable  if  and  only  if 

"  sup  (ReA  :  det  A  (A)  «  0}  <  o 

A*.  A’  . 

where  A(A)  ■  A  [I  -  M(e  )]  -L(e  ),  A  t  C  ,  is  the  characteristic  matrix  of 
the  NTDE  (4.1).  A  necessary  condition  for  the  exponential  stability  of  S(t) 
is  the  stability  of  the  difference  operator  which  means  that 
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“  -Xh. 

(4.7)  sup  (ReX:  det[I  -  J  A_j  J]  —  0}  <  0. 

j-1 

These  facts  have  been  established  by  HENRY  [21]  for  S(t)  4  £  (w).  They 

i2 

(M  )  because  of  Che  similarity  of  these  two  semigroups 
2 

through  the  transformation  yI-A:W  +  M  with  y  ^  e-(A). 

(iv)  If  Ms  £  ■*  fc."  is  given  by  (4.3)  and  if  (4.7)  holds,  then  system  (4.1) 
is  stabiliaable  in  the  sense  that  there  exists  a  feedback  operator 
F  4  £  (M2,  (Lm)  such  that  the  closed  loop  semigroup  Sj,(t)  4  £  (M2) 
generated  by  A  +  BF  is  exponentially  stable  if  and  only  if 

(4.8)  rank  £  A(X),Bo  J  »  n  ^X  &  <£,  ,  ReXjo. 

(PAMDOLFI  [38],  SALAMON  [40]). 

(v)  If  M:  •*  (SLn  is  given  by  (4.3)  and  if  (4.7)  holds,  then  system  (4.1) 

is  detectable  in  the  sense  that  there  exists  an  output  injection  operator 
K  e*(«LP,  M2)  such  that  the  closed  loop  semigroup  SR(t)  4  «L  (M2)  generated  by 
A  ♦  KC  is  exponentially  stable  if  and  only  if 

’  A<A> 

(4.9)  rank  .  ■  n  vXfct,  ReXjo. 

.  C(eA*) 

(SALAMON  [40]). 

Associated  with  the  system  (4.1)  we  consider  the  performance  index 

m 

(4.10)  J(u)  -  [  (||  y (t) || 2  +  ||  u<t) || 2  ]dt 

0  Rp  li\B 

Then  we  have  the  following  theorem. 
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Theorem  4.2 


Assume  M:  ^  \^n  it  given  by  (4.3)  and  (4.7)  is  satisfied,  Chen 

Che  following  stacesiencs  hold. 

2 

(i)  If  (4.8  )  is  satisfied,  Chere  exists,  for  every  initial  state  $  A  M  , 
a  unique  optimal  control  which  minimizes  the  cost  functional  (4.10).  This 
optimal  control  is  given  by  the  feedback  law 

(4.11)  «w(t)  -  -  BSJ(t) 

2 

where  ir  £  ;£  (M  )  is  the  minimal  selfadjoint,  non-negative  operator 

which  satisfies  the  algebraic  Riccati  equation 

(4.12)  A%  ♦  irA  ♦  C*C  -  *BB*ir  -  0 

(this  equation  must  be  understood  in  Che  space  i(w,W*)).  Moreover  the 
optimal  cost  is  given  by 

(4.13)  J(u  ) 

(ii)  If  (4.3)  is  satisfied,  then  there  exists  at  most  one  non-negative  self 
adjoint  solution  it  £  ^  (M2)  of  (4.12).  Moreover  if  it  is  such  a  solution,  Che 

a  2  h 

closed  loop  semigroup  S  (t)  (  Z.  (M  )  generated  by  A-BB  ir  is  exponentially 

IT 

stable. 

Apparently  the  paper  of  DATKO  [ 10]  and  the  thesis  of  ITO  [25]  have  Che 
only  available  results  in  the  literature  on  the  linear  quadratic  control  problem 
for  neutral  systems.  In  DATKO'  [10]  the  optimal  control  is  not  shown  to  be 
of  feedback  form.  ITO  [25]  considers  neutral  systems  in  the  product  space 
framework,  however  his  detectability  concept  is  very  strong  and  unnatural. 
Moreover,  the  proofs  appearing  in  both  papers  are  quite  complicated. 
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4.2  Parabolic  systems 

Consider  Che  system 
x  «*  Ax  ♦  Bu 

(4.14) 

y  -  Cx 

where  A  is  a  self  adjoint  operator  on  a  real  Hilbert  space  H.  Let  *n,  n  6  frJ  > 
be  the  (simple)  eigenvalues  of  A  with  corresponding  eigenvectors  &  H,  II  ♦  nll  " 

and  assume  }X  j  -*•  as  n  +  ®  and  •••  X^  <#.#<X^  $  constant*  Then 
« 

**  “  l  \  K  X*  Vh  *n 

n-1 

(4-15>  “  2  2 

D(A)  -  {x  €  H  :  l  <x,«  n>H  <  -  } 

n»l 

and  A  generates  a  strongly  continuous  semigroup  S(t)  on  H,  where 

C9 

(4.16)  S(t)x  -  l  eAnC  <*.*n><’n* 
n“l 

A  precise  definition  of  the  operators  B  and  C  will  be  given  below.  For  now, 
we  only  assume  that  the  expressions 

(4.17)  c  -  C  <p  €.  Y,  b  -  B*  ♦  fc  U, 
n  n  n  n 

are  well  defined  for  every  n  4  |)1  .  The  operators  B  and  C  are  completely 

determined  by  these  sequences.  The  remaining  problem  is  to  introduce  -  if 
possible  -  suitable  spaces  W  and  V  such  that  B  4  it(U,V),  C  4  ^jL(W,Y)  and 

Chat  the  hypotheses  (HI)  and  (H2)  are  satisfied.  It  will  turn  out  that  there 

is  in  general  some  freedom  in  the  choice  of  these  spaces  if  they  exist. 
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More  precisely,  for  any  positive  sequence 


a  -  {a  }  , 

n«fl4 

we  define  the  Hilbert  space 


>0  Vn  *  M 


V  *  {x  *  (xn>  8  I  »*?<-> 


itfci  n-1 


n  n 


with  inner  produce 


<X,x>a  "  ^  anVn  *  x*x  €  Ha 

n-1 


Remarks  4.3 


(i)  We  may  identify  H  with  via  the  isometric  isomorphism 


i  S  H  ♦  H 


{<  *.  ♦  >  >  , 
"  Hn*i 


i“l  s  H, 


-  H, 


<V 


I  *  ♦ 


n*l 


n  n 


(ii)  H  <  H  if  and  only  if  the  sequence  a  /8  is  bounded. 

*>  *  n  n 

m 

(iii)  Ho  •  H  -  (  x  :  l  x*  <  »  } 

**  n-1 

with  respect  to  the  duality  pairing 


<XV>  ’  J,  X"  *n  ’  x*«  «  -!  •  88  *  »a. 


(iv)  +  e  H  can  be  identified  with  the  sequence  e  -  (0,...,  1,  0,  ...)via 
a  a 

the  mapping  i.  This  sequence  is  contained  in  any  H  . 
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Now  we  may  associate  with  the  operator  A  a  whole  family  of  operators  A 

on  H  defined  by 
o 


i)<V  “  (x  «  H0 


n 


2 


x 


n 


< 


) 


A  x 
a 


{A 

n 


e  ivi 


Each  of  these  operators  generates  a  strongly  continuous  semigroup  Sft(t)  € 
which  is  given  by 

S  (t)x  -  {eAnt  x  }  ,  t  i  o,  x  6  H  . 

a  n  a 

n«  \kJ 

Associated  with  the  sequences  (4.17)  we  introduce  the  maps 

(4.18)  Bg  :  U  *  Hg  . 

u  (<b  ,u>  )  i 
n  U  « t  W 

(4.19)  Cy  ;  Hy 

x 

However,  these  operators  are  not  well  defined  for  every  choice  of  0  and  y 
respectively.  Sufficient  conditions  of  well  posedness  of  (4.18)  and  (4.19) 
as  well  as  for  the  Hypotheses  (HI)  and  (H2)  are  given  in  the  next  Leona. 


Y  , 


n“l 


x  c 
n  n 


Leona  4.4 

(i)  « 

(4.20)  l  6  ||  b  ||2  <- 

n-1  n  n  U 


f  ( Ha) 
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then  (4.18)  defines  a  bounded  operator  B  g  )f(U,H  ). 

B  B 

In  the  case  U  ■  condition  (4.20)  is  also  necessary* 
<ii)  If 

(4.21)  l  ■—  ||  c  ||2  <  -  , 
n-1  «  Y 


then  (4.19)  defines  a  bounded  operator  g  a[(H^,Y).  In  the  case  U  - 
condition  (4.21)  is  also  necessary. 

(iii)  Let  nQ  •  max  (n  6  thi  :  A  i  o),  let  (4.20)  be  satisfied  and  suppose  that 


(4.22)  l  — 2- 

n-nQ+l  l*n| 


Then,  for  every  T  >  o,  there  exists  a  constant  b  >  o  such  that 
T 


H  |  S8(T-s)B6u(s)ds||Y  S  b  ||  u(-)| 


L2[o,T;U] 


for  every  u(-)  t  L  [o,T;U]. 


(iv)  If  (4.21)  holds  and 

«• 

(4.23)  l  1 


FTXT  °n  y 

n-n0+l  n  n 


then,  for  every  T  >  o,  there  exists  a  constant  c  >  o  such  that 


l|C  S  (-)x||  $  c  ||x|| 

T  T  2  a 

L  lo,T;Y]  S 


for  every  x  fc 


H  . 


T 


Proof  First  note  that  (ii)  and  (iv)  are  the  dual  statements  of  (i)  and  (iii) 
respectively.  Statement  (i)  is  trivial  and  (iii)  follows  from  the  inequality. 
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11 1 


Sg(T-s)Bgu(s)ds  || 


X(T-s)  \  2 

:  b  u(s)ds  / 

n  / 


2X  3 
e  n  ds 


u(  * )  | 


L2[o,T; 


2 


l|u(.)||2 

L2(o,T;  ftm) 


So  we  have  to  consider  the  problem  whether  there  exists  sequences  6  ,  Y  such 

n  n 

that  the  inequalities  (4.20-23)  are  satisfied.  This  problem  has  a  simple 
solution. 


Lemua  4 . 5 

Given  the  sequences  b  €  U,  C  ft  V,  i  «(£.  such  that  X  is  strictly 
n  n  n  n 

decreasing  and  tends  to  -  "  ,  there  exist  sequences  B  >  o,  Y  >  o  such 

Q  O 

that  the  inequalities  (4.20-23)  are  satisfied  if  and  only  if 

JO 

(4.24)  l 

n-n  +1 
o 

Proof 

Necessity  It  follows  from  (4.20)  and  (4.23)  that 
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-  r°n>-iit»ii„  <  -  ii 

»-n  •»!  lAn^  n-n0+l  6rJ*tJ 


c  „2 

°ll  Y 


l  6tJI  bc 


n-n  +1 
o 


Sufficiency  Suppose  chat  (4.24)  is  satisfied  end  define 


(4.25)  S_ 


le«ll¥/llbn|l0lA«|l.  bn  +  °*  Ca  +  0>  *n  *  °* 

“2  llCn|ly /lX«l  «  bn"°*  Cn  ♦  °*  Xn  *  °* 


l/«  II  »>„ 


b+o,  c«o,  l  f° 
n  1  n  n 


otherwise 


(4.26)  y 


lAnl  H  cnll  /W  bJlu»  bn  +  °*  cn  +  °*  X„  *  °’ 


bn  “  °*  '«+  °*  Xn  *  °* 


l*J/«2llbJo  •  bnf«.  An  +  °* 


max  (  1 , | | )  , 


otherwise 


Then  it  is  easy  to  see  that  (4.20-23)  are  satisfied.  722 


Remarks  4.6 

(i)  Let  (4.24)  be  satisfied  and  let  B  and  y  be  given  by  (4.25)  and  (4.26) 

n  n 

respectively.  Then  y  *  I A n I  *OZ  a*mo*t  every  n  f  (with  at  most  a 


finite  number  of  exceptions)  and  hence 


5)<V  C  SUgS  -  {x:  l  BjAj  V  -  )  ■  Hr  C  H9 


In  particular,  hypothesis  (H3)  is  satisfied* 

(ii)  If  the  sequence  8  ly  is  bounded,  then  we  may  assume  without  loss  of 
q  n 

generality  that  H  CH.  €.  H  or  equivalently  that  the  sequences  0  and  y 

Y  1  8  n  n 

are  bounded.  This  can  always  be  achieved  by  redefining  b  ,c  ,6  and  y  . 

n  n  n  n 


(iii)  Th*  system  (4. 14)  is  s tabi  lizable  in  the  sense  that  there  exists  an 

*0  4  *uch  that  Ag  +  Bg  Fg  generates  an  exponentially  stable 

semigroup  if  and  only  if  b  4>  o  for  n  -  1 . .  n  where  n  is  defined  as  in 

n  o  O 

lemma  4.4(c)  (see  CURTA IN-PRITCHARD  (9]). 

(iv)  Let  (4.23)  and  (4.21)  be  satisfied.  Then  system  (4.14)  is  detectable 
in  the  sense  that  there  exists  a  Kg  C  J?(Y,Kg)  such  that  the  operator 

^8  *  KB  ‘  2^*g).  **g  generates  an  exponentially  stable  semigroup  on  Hg 

if  and  only  if  f  o  for  n  “  1,  . ...  nQ.  This  is  not  the  dual  problem  of 

(iii)  since  K  C  is  an  unbounded  perturbation  of  A..  However,  if  c  |  o  for 
BY  8  n 

n  •  1 . .  ,  then  we  may  choose  f,,  ....  f  e  Y  such  that  the  matrix 

o  1  n„ 


'  - 

* 

X1 

% 

«* 

% 

* 

V 

N 

♦ 

<f1*ci>  *  •  •  <£1-V 

A 

no 

"VV*--  <f"o'  V 

is  stablc  and  define  K„  :  Y  •»  H, 


V 


-  {'f  ,y>) 

n  4  tt4 


where  f  ■  o  for  n  >  no*  Then  it  follows  from  the  finite-dimensionality  of 
Kg  that  Ag  ♦  Kg  generates  a  semigroup  (SALAMON  [40]) and  it  is  easy  to  see 
that  this  semigroup  is  exponentially  stable. 

Now  we  are  in  the  position  to  apply  the  Theorems  3.3  and  3.4  to  the  Cauchy 
problem  (4.14)  with  the  performance  index  (4.10). 


Theorem  4.7 

Let  the  operators  A,  B,  C  be  given  as  above.  Suppose  that  (4.24)  is 
satisfied,  let  8^  and  yr  be  given  by  (4.25)  and  (4.26)  respectively  and  assume 
that  H^CHj  C.  Hfl.  Finally,  suppose  that  bn  f  o  and  cr  f  o  for  n  -  1 . no< 
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Then  the  following  statements  hold. 


(i)  There  exists  a  unique  family  (p  £  it  defining  a  self-adjoint. 


n-negative  operator  P  t  ^  (H  ,  H  ,)  via 

ft  fl  * 


P*‘{  l  Pn.m  V 

*“1  ne»J 


•  x  e  v 


and  satisfying  the  following  equation  for  all  n,m 


(4.27) 


(A  ♦  A  )p  ♦<c,c> 
n  m  nfm  n  m 


-l  I  Pni  <b;*V  K  m- 
j-i  k-i  n'J  J  k  u  k’ 


(ii)  For  every  initial  state  x  tc  H  there  exists  a  unique  optimal  control 

O  p 

which  minimizes  the  cost  functional  (4.10)  subject  to  (4.14).  This  optimal 
control  is  given  by  the  feedback  law. 


(4.28)  u(t)  -  -  B*Px(t)  •  -  l  l  b  p  <x(t),0 

n  n,m  n 

n-l  m-1 


(note  that  x(t)  €  H  for  t  >  o)  where  p  ,  n,m  £  (hi,  are  defined  as  above. 

n,m 

The  optimal  cost  is 


(4.29)  J(u)  -  J  [  x  p  x  . 

n-l  m-1  on  n,m  001 


Moreover,  the  closed  loop  semigroup  on  H  ,  generated  by  A  -  B  BP  is 

P  P  P  P 


exponentially  stable.  E3 


As  a  specific  example  consider 


(4.30;1)  *t  -  z?5,  t  >  o,  o  <  ?  <  1, 
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(4. 30; 2)  *^(o,t)  -  u(t),  z^d.t)  -  o,  t  >  o. 


(4.30;3)  z(£,o)  -  zo(£).  o  <  5  <  1, 

X 

(4. 30; 4)  y (t)  -  j  c(£)z(£,t)d£,  t  >  o. 
o 

It  can  be  shown  (see  CURTAIN-PR1TCHARD  [  9 ])  that  this  system  is  equivalent 
to  a  Cauchy  problem  of  the  form  (4.14)  with  (Bu)  (£)  »  -  6(£)u  (4  is  the 

2  2  r  T  — 

Dirac  delta  function),  X  ■  o,  4  (£)  5  It  X  ■  -  n  *  ,  4  (£)  “  »2  cos«iw£ 

o  o  n  n 

for  n  «  nl  and  o  $  £  $  1.  Hence 

b  -  -1,  b  -  -  /2  ,  n  «  Ihi 

o  n 

1 

Cn  “  j  c(0*n<*)d£,  n  -  o,  1,  2, . 

o 

So  condition  (4.24)  is  satisfied  if 


r  ^n 

y  —  <  » 

7  n 

n-1 


This  allows  for  arbitrary  bounded,  linear  output  operators  from  l/[o,l] 
into  which  means  that  c(-)  L^[o,l]  or  equivalently  the  sequence  cn 

is  square  suranable.  However,  the  output  operator  can*also  be  unbounded.  For 
example,  if  cq  ■  n  then  we  may  choose  «  n*  and  Sn  ■  n  *  so  that 
W,  V  are  the  intermediate  spaces 


(V  [o,l],  L2[o,1]1  =  , 

U  Ji  +  e 

[Hl[o,l],  L2[o,1]]*(  =  (h**£[0,1])#  . 


In  particular  the  solution  operator  P  of  the  algebraic  Riccati  equation  maps 

,  1 .  .*■  1 


/f.  \  j-c 

(h*  (o.lljinto  H 1  [o.l]. 


♦.3  Hyperbolic  systems 
Consider  chs  system 

(4.31)  s  ■  As  ♦  Bu,  y  ■  Cl, 

Where  A  is  a  selfadjoint  operator  on  a  Hilbert  space  H  whose  (simple) 

5 

eigenvalues  X  •  -  u  satisfy 
n  o 

(4.32)  Wl»d,  Vl"“n*  *•  n|t^* 

for  some  4  >  0.  As  before,  let  4&  6  H  be  the  corresponding  eigen¬ 
vectors  of  A  with  ||g  ||  -  1  so  that  A  is  given  by  (4.15).  For  the 

operators  B  and  C  we  only  assume  that  the  expressions  (4.17)  are  well 
defined. 

Identifying  H  with  its  dual,  we  obtain 
V  C  H  C-  v*  , 


V  -9((-A)J)  lx  e  U  :  l  IxJ  <  x  ,#n  >2  <  ->, 

n-1 


and  A  extends  to  a  bounded  operator  from  V  into  V*.  In  order  to 
transform  (4.31)  into  a  first  order  system,  we  introduce  the  Hilbert  space 
CJj'  -  V  x  H 


+  <*, 


*.,x1>  .x.xfetJf. 

V,V"  1  H 

Then  the  operator  Q_  :  i,  ( Q.)  defined  by 


<x,x>  -  -  <x  ,Ax  > 

yf  °  ° 


a 


o 

A 


.  $(0) 


-  0  (A)  X  V  , 


is  the  infinitesimal  generator  of  a  strongly  continuous  group  $  (t)  €  &  (CfO 
which  is  given  by 
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(4.33)  /(Ox- 


J  C<cos“nt)<x0,  *n  >  +  “5  -nt)  <  xi,*n  >]*, 


C-“n<sin“nt)  <VV  ♦  (co.  «nt)  <  xr4n>]4n  J 

tor  x  *  (xo,Xj)fc  Jvj"  and  t  *  0.  Moreover,  ve  introduce  the  operators 

?  "  [c°] 


B 


Then  the  second  order  systea  (4.31)  can  be  formally  associated  with  the 
first  order  Cauchy  problem 
x  -  &x+  3U 


(4.34) 


n-1 


on  the  Hilbert  space %  by  means  of  tha  identification  x  -  (*,*).  In 

order  to  give  a  precise  definition  of  the  operators  ^  and  £  we 

introduce,  for  any  positive  sequence  a  «  (a  La  >  0,  the  Hilbert 

n  1  Q 

•p*c« 

X-  <x  -  «xon«*ln)}nfc^  !l««[lXnl*Jn  *  xl]  <  “  > 

-  Ha|x|  *  Ha 
endowed  with  the  inner  product 

<  V  "a  “  ]“n  [K  Ij 

end  we  identify^  with  the  Hilbert  space 3^  by  means  of  the  isometric 
isomorphism 

i  =  —  Jf, . 

*  — •  <  ‘rV11..  nj  • 

Then  we  may  associate  with  the  operator  £1  the  family  of  operators 
on  ^  defined  by 


A  A 

•xon  xon  *  xin 


*ln  ]  *  ***  * 


{(xln’Xnxon)}n«t>4' 
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J)<aa>  -  <*  t  *  Jx  «J*J  [j\>ou  +  xlJ  <  "  } 


Each  of  these  operators  generates  a  strongly  continuous  group 
jfa(t)  €  )  which  is  given  by 


£„<t)x 


(cos  «  t)  X  ♦  w"1  (sin  w  t)  x, 
n  on  n  n  in 


(S  (sin  is  t)  X  ♦  (cos  (s  t)  x- 
q  q  on  n  in 


J  nc 


for  and  t  »  0.  Associated  with  the  sequences  (4.1?)  we 

introduce  the  naps 
(4.35)  GS:U— 

u  *  {{0*  <bn*u  V}n«^' 


(4.36) 


r, 

I  e  x 

L,  n  on 
n-1 


Lemea  4.8 
(i)  If 

(4.37)  l  8  ||b  ||2 

n-1  0 

then  (4.35)  defines  a  bounded  operator  t  jt(U^^).  In  the  case 
0  -  ft,  this  condition  is  also  sufficient. 


(ii)  If 
(4.38) 


i  ilils  <. 

n  n 


then  (4.36)  defines  a  bounded  operator  €  of  (  9fy,  Y).  In  the  case 

Y  -  lE.  this  condition  is  also  sufficient. 

(Hi)  If  (4.37)  holds  and 

(4.39)  aup. Yn  | |bn| |y  <-  , 

n  •  $* 

then,  for  every  T  >  0,  there  exists  a  constant  b  >  0  such  that 
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II  I  So  (T-s)pfl  u(s)ds  1 1  e  b  ||u(.)l 


3  "r6 


L  (0,T;U) 


for  every  u(»)  fc  u  (0,T;U). 

(iv)  If  (4.38)  holds  and 
2 

(4.40)  sup  -U-  nl  1^  <  ®  , 

n€lW  8nlra! 

then,  for  every  T  >  0,  there  exists  a  constant  c  >  0  such  that 

II  JTy<*)x||  2  4  c  1 1*|  lg 

c  Y  T  L  (0,T;Y)  0 

for  every  x  c  . 

Proof  The  statements  (i)  and  (ii)  are  trivial.  In  order  to  prove 
statement  (iii)  note  that  _  T 


J  1 6<T-a>#0  u 


(s)ds 


u  1  j  (sinwR(T-s))  <  bn>  u(s)>Dds 


|  (cos«n(T-s))  <  bjj,u(s)>uds 


n  t  fci 


for  every  u(*)  £  L  (0,T;U)  and  hence 
T 

||  jXB(T-*)/?B  u(s)  ds  ||* 


l  Yn  \  [  J(sinu)n(T-s))  <  u(s)  ^ds] 


n*l 


if 

♦  [|(cosun(T-s))  <  bn,u(s)  >^ds] 


«  C»«p  Ynl |b  I  I2)  I  < 

n  n  n-1 


T 

♦  ||  |  (coswn(T-s))u(s)  ds 


||  |(sinun(T-s))u(s)  ds  ||* 
o 

n;} 
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:2 


i  const,  (tup  'rnl|bn|r)||u(.)|| 

L2(0,T;U) 

For  ths  final  inequality  we  have  to  maice  use  of  condition  (4.32) 

together  with  some  properties  of  Fourier  series 
(see  INC HAM  [24]  and  also  RUSSELL  [39,  p.12-14}). 

Finally,  let  us  assume  that  (4.38)  and  (4.40)  are  satisfied.  Then  the 
following  inequality  holds  for  every  x  £  and  every  y(*)  £  L2(0,T;Y) 


<y(*),  /?  ^  (‘)x> 

*  Y  Y 


L^O.TjY) 


m  I  *  I  y(t)cosutdtx  (  y(t)sinu  tdtx,  , 

)  n  on  n  j  n  in 


c  > 

n 


o-l  0 


*  [  *  l|cn1!"  Xon]  [  l  H  |  3T(t)eo.-  tdt||*] 

U  n-1  Y  *  n-1  o  1 

*  [  l  Xln]  [  l  11  }  tdt|| 

n-l  *  n-1  o 

J"  8up.  1 1  cnll  v/6nl  Xr,l  ]  2 

"  ¥  "  “  J  L2(0,T;Y) 

{[  Ji  vLl'} 


S  const 


t  const.  ||  y (•)  ||  11*11 

Lz(0,T;Y)  B 

This  proves  statement  (iv).  Y/A 
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If  (4.41)  is  satisfied  and  8  and  y  are  given  by  (4.42)  and  (4.43),  tes- 

n  n 

pectively,  then  it  follows  from  Lemma  4.9  and  Lemma  4.8  that  system  (4.34) 
satisfies  the  hypotheses  (HI),  (H2)  and  (H3)  with 


u  v>  ■  X- 

This  time  we  will  not  assume  that  ^  C^g  so  that  we  are  not 

tied  to  an  artificial  identification  of  a  certain  Hilbert  space  with  itself 
which  sometimes  leads  to  unnecessary  complications.  Nevertheless,  we  can 
apply  Theorem  2.6  to  our  situation  since  the  intermediate  Hilbert  space  H 
does  not  play  any  role  in  the  proof  of  that  result. 

By  Theorem  2.6,  there  exists  a  unique  positive  semidefinite  strongly 
continuous  operator 

if  (t)  6  (  iHg*  0  f  t  f  T. 

which  satisfies  the  differential  Riccati  equation  associated  with  system 
(4.34)  and  the  performance  index 

T 

(4.44)  T (u)  «  j  (||y(t)||*  ♦  ||  u(t)||*]  dt. 

0 

This  operator  can  be  written  in  the  form 


(4.45) 


IP 


(t)x  - 


l  (p„(t)x  ♦  PnB(t)x  ) 

jjj  nm  on  no  in 

l  <Pnn(c>xom  +  P^COx,) 
^  on  on  run  in 


n  €  1 


for  x  £  and  0  $  t  $  T.  The  fact  that  'P  (t)  is  self-adjoint  results 


in  the  condition 


(4.46) 


.  00,  .  .  00,  ,  10.  ,  ,  01.  . 
X  p  (t)  -  A  p  (t),  p  (t)  *  -  X  p  (t) 
m  mn  n  nm  rmn  n  nm 


11/  s  11/  X 

P  (t)  »  Pn_(<:), 
mn  run 


for  n,  m  £  tvi  and  0  f  t  S  T.  In  the  next  theorem  we  summarize  our  main 
conclusions  for  the  Cauchy  problem  (4.34)  with  the  cost  functional  (4.44). 


Theorem  4.10 

Let  the  operators  Q.  ,  %  ,  ^  be  defined  as  above.  Suppose  that  (4.41) 

is  satisfied  and  let  8  and  y  be  defined  by  (4.42)  and  (4.43),  respectively, 
n  n 

Then  the  following  statements  hold. 

(i)  There  exists  a  unique  positive  semidef inice  operator  1?  (t):  tf-f  .  •*  ^"fg-1 

of  the  form  (4.45),  (4.46)  whose  coefficients  p°°(t),  p10(t),  p11(t)  are 

nm  nm  nm 

continuously  differentiable  on  the  interval  [0,T]  and  satisfy  the  differential 
Riccati  equation 


(4.47;  1) 


-*nCU)  +  XnP™(t)  +  XmP^(t)  +  <Cn’V 

■  l  l  <bj'Vu 

j  k  u 


(4.47;2) 


.10,  .  ,  00,  ,  ,  11.  . 
P  ( t )  -  A  p  (t)  ♦  A  p  (t) 
nm  n  nm  m  mn 


?  1  <bj *Vn  pjm(c)  pii(t)* 

j  k  v 


(4,47;  3) 


•11,  .  10,  ,  10,  . 
P„m(t)  +  Pn_(t)  ♦  P  (t) 
nm  nm  mn 


1  1  *bi'Vu 


j  k 


(4.47;4)  p°°(T)  -  p*°(T)  -  p“(T)  -  0, 

nm  nm  no 


for  n,n  fc  and  0  $  t  {  I. 
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'  ** 


(ii)  For  every  initial  state  (x^.x^)  £  tH  there  exists  a  unique  optimal 
control  u(t),  0  s  t  s  T,  which  minimizes  the  cost  functional  (4.44)  subject 
to  (4.34).  This  optimal  control  is  given  by  the  feedback  law 


(4.48) 


u(t)  -  -  £>  *  P(t)x<t) 


"  ~  l  I  b  [p*°(t)<x  (t),p  >  *  pii(t)<x.(t),  6>  ]. 

n  run  o  m  H  no  1  0 


The  optimal  cost  is 


J(u)  -  <(xo,x1),  ^(o)(xo,x1)> 


•  Z  *  [~<xo*V 

■>  m  ■ 


>1  p^(0)<x  ,♦  > 

n  nm'  o’  m 


♦  2  <x  >  p*°(0)<x  ,*  >  +  <x  >  p“(0)<x1  ,*>  . 

1  n  nm  o  m  in  nm  1  m  1 


As  a  specific  example,  consider  the  system 


(4.30; 1)  «tt  -  t  >  o,  0  <  C  <  1. 


(4.50;2)  z (o , t)  -  u(t),  z(l,t)  -  0,  t  >  o. 


(4.50;3)  z(5,o)  -  x  (5),  z„(C,0)  -  x.U),  0  <  K  <  1, 

O  t  1 


(4.50;4)  y(t)  -  c(Oz(C,t)dC,  t  >  o. 


in  the  Hilbert  space 


-  h!  [0 , 1  ]  x  L2(0,1 } 


which  we  identify  with  its  dual.  Then  the  operator 


A  -  A,  2(A)  -  H2[0,1]  n  hJ[0,1], 
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I 


has  the  eigenvalues  ■  -  n  n  with  corresponding  eigenfunctions 

♦  n(0  -  /l  sin  n»C.  0  f  C  <  1.  n  £  #4  ,  and  Q.  :  Q  (Q.)  -  tH  is 
given  by 


9  (ft>-  $  (  a  >  *  hJ  [o,i] 


Moreover,  the  input  operator  for  system  (4.50)  takes  the  form  u  «  (o,-6’u), 
u  fc  (15,  ,  where  4'  is  the  distributional  derivative  of  the  Dirac  delta 

impulse  at  (  ■  0  (see  CURTAIN-PRITCHARD  (9]).  Hence  the  following  equations 
hold  for  n  4  (hi 


b  "  S  $  “  ♦  (o)  ■  /2  n  e , 

n  n  n 

i 

_  _  r 

c  -  ■€  *  *  /2  I  c(?)sin  n  it  £d  £ 

n  v  n  l 

o 

So  condition  (4. 41)  is  satisfied  if  and  only  if 

(4.51)  l  |cn|  <  - 
n-l 

and  we  may  choose 


B  -  max  ,  — ~  )  ,  Y 

n  i  i  \  1 2  r 


i*.i  i*,i' 


(compare  the  formulae  (4.42)  and  (4.43). 


n  *■  1-i  , 


In  particular,  this  means  that  the  boundary  control  system  (4.50)  has  continuous 
solutions  in  the  space 


-  L2  [o,l]  x  H  1  to,  1] 


for  every  input  u(*)  fc  L 


2 

loc 


(o,»). 


This  result  has  also  been  established  by 
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LASIECKA-TRIGGIANI  [32].  Moreover,  condition  (4.51)  show*  that  C  can  be 


2 

chosen  to  be  arbitrary  bounded  linear  functional  on  L  [o,l].  The  space 

^  0  depends  on  this  functional.  For  example  if  C  ■  n  *,  then  we 

B  n 

can  choose  ■  n  and  get 
n 


if  -  -  H-1[o,l]  x  0(A)' 


In  this  situation  it  is  usual  to  take 


as  the  state  space  instead  of 


and  identifying  with  its  dual  we  have 


'V*  -  aJ[o,l]  x  L2[o.l] 

and  (t)  maps^,^  into  1/  .  Hence  the  Riccati  operator  has  a  smoothing 

effecC  with  respect  to  -  L2[o,l]  x  H_1  [o,  1] . 

Remarks 

Boundary  value  control  problems  for  parabolic  and  hyperbolic  systems 

have  been  treated  by  a  variety  of  authors,  for  example  BALAKRISHNAN  [2], 

WASHBURN  [42],  LIONS  [34],  CURTAIN-PRITCHARD  [9],  LASIECKA-TRICC1ANI  [31], 

[32].  The  weakest  conditions  imposed  to  generate  a  solution  of  the  Riccati 

equation  for  hyperbolic  systems  are  those  of  LAS IECKA-TRICG IAN I  [32].  They 

study  precisely  the  boundary  control  problem  (4.50)  where  the  output  operator 
2 

is  the  identity  on  L  [o,l].  This  case  cannot  be  treated  within  our  framework, 
however,  the  Riccati  operator  in  [32]  is  in  ^  ( 'li  )  and  does  not  have  a 
smoothing  effect  relative  to  «  L  [o,l]  x  H  *[0,1] . 


PART  II 


In  this  part  we  develop  a  state  space  approach  for  linear  retarded 
functional  differential  equations  (RFDE)  having  general  delays  in  the  state  - 
and  input/output  -  variables.  This  will  be  done  in  the  context  of  semigroup 
theory.  In  particular,  we  extend  the  concept  of  structural  operators 
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(BERN IER-MAN IT IUS  (4),  MANITIUS  [35],  DE LFOUR-MAN IT IU S  [19],  VINTER-KKONG 
[4l],  DELFOUR  [16])  Co  RFDEs  with  delays  in  both  input  and  oucput  variables 
and  we  develop  a  duality  cheory  for  this  class  of  systems  (Section  5).  In 
Section  6  we  make  use  of  these  results  in  order  to  apply  our  general  theory 
of  the  linear  quadratic  optimal  control  problem  to  RFDEs  with  input/output 
delays . 

S.  STATE  SPACE  THEORY  FOR  RETARDED  SYSTEMS  WITH  DELAYS  IN  INPUT  AND  OUTPUT 

5.1  Control  systems  with  delays 
We  consider  the  linear  RFDE 

(5. 1 ; 1)  x(t)  -  Lxt  +  But  , 

(5 . 1 ;  2 )  y  (t)  -  Cxt  , 

where  x(t)  «.  iK",  u(t)  *  y(t)  £  lg.P  and  xt,  u£  are  defined  by 

xt(r)  -  x(t+x),  ut(x)  »  u(t+T)  for  -h  .<  T  $  0  (0  <  h  <  *>) . 

Correspondingly  L,  B,  C  are  bounded  linear  functionals  from  ^  »  C  (-h,0;  t^n) 
respectively  C  (~h,0;  (^m)  into  respectively  fi^p.  These  can  be 

represented  by  matrix  functions  n(x),  B(t),  y(x)  in  the  following  way 

h  h 

L*  ■  dn(x)*(-x),  C$  -  dy(x)6(-T),  $£C(-h,0;  ^n) » 

-'o  'o 

h 

B?  =  |  dB(T)E(-T),  5  t  C(-h,0;  fc,m). 
o 

Without  loss  of  generality  we  assume  that  the  matrix  functions  n, 8  and  y 
are  normalised,  i.e.  vanish  for  x  S  0,  are  constant  for  x  5  h  and  left 

continuous  for  0  <  x  <  h.  A  solution  of  (5.1;1)  is  a  function 

2  n  2 

X  4  L‘  (-h,-;  \V  )  which  is  absolutely  continuous  with  L  -  derivative  on 
loc 
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•very  compact  interval  [0,T] ,  T  >  0,  and  eatiafiea  (5.1; 1)  for  almost  every 
t  5  0«  It  ia  well  known  chat  (5.1;1)  admits  a  unique  solution  x(t)*  x(t;P,u), 
t  J  ”  h,  for  every  input  u(*)  £  L|oc^°>“5  B^*)  end  every  initial  condition 


(5.2;1)  x(o)  - 

X(T)  -  ♦^T) 

(5. 2; 2)  u(t)  -  ♦2(t), 

-  h  S  t  <  0, 

where  *  -  (d0.*1,*2)*.  *  -  Rn  x  L2(-h,0;  Rn)  x  L2(-h.O;  fcV 
Motcovct i  x(*£$tu)  depends  continuously  on  ^  end  u  on  coop set  intctvtli t 
i.«e  for  any  T  >  0  there  exists  a  K  >  o  such  that 

||  x(-;«p,u)  |]  i  K  [*(1)  *||e||u|| 

Wl’2<0,t;  fc")  L  L2 (0,T;  *“) 

2  1/2 

where  fU  II  -C|U°||  ♦  lUV*  ||*2j(2  )  for  *  e  * 

L2  L2 

(see  e.g.  BORISOVIC-TURBABIN  [5],  DELFOUR-MANITIUS  [19],  SAUMON  [40]).  The 
corresponding  output  y(-)  -  y(.;*,u)  is  in  L2^  (o,-;  |R.P)  and  depends  - 
in  this  space  -  continuously  on  ♦  and  u.  The  fundamental  solution  of 
(5*1*1)  will  be  denoted  by  X(t),  t  i  -h,  and  is  the  nxn  matrix  valued 
solution  of  (5. 1; 1)  which  corresponds  to  u  =  o  and  satisfies  X(o)  -  I, 

X(t)  <•  0  for  -h  $  -r  <  0.  Its  Laplace  transform  is  given  by  A^O),  where 

h 

AO)  ■  Xl  -  L(e*')  -  \  I  -  f  dn(T)e"XT  \  €  C, 

is  the  characteristic  matrix  of  (5.1;1).  It  is  well  known  that  the  forced 

motions  of  (5,l;l)  can  be  written  in  the  form 

t 

x(t;o,u)  -  f  X(t-s)Busds,  t  i  0. 
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We  also  consider  the  transposed  RfDE 


(5.3;1)  z(t)  -  LTzt  +  CTvt  , 

(5.3;2)  w(t)  -  BT*t, 

with  initial  data 

(5.4;1)  z(o)  -  *°,  z(t)  -  ^(T). 

(5.4;2)  v(t)  -  *2(t),  -h  f  t  <  0 » 

where  *  -  (i>°,^1,*2)  €  St*  -  1^°  *  L2(-h,o5  (t")xL2(-h,o;  Rp). 

The  unique  solution  of  (5.3;1)  and  (5.4)  will  be  denoted  by  z(t)  -  z(ttf,v), 
t  >  -  h ,  and  the  corresponding  output  by  w(t)  -  v(t;i(i,v),  t  i  o. 

5.2  State  Concepts  and  Duality 

The  'classical'  way  of  introducing  the  state  of  a  delay  system  is  to 
specify  an  initial  function  of  suitable  length  which  describes  the  past  history 
of  the  solution.  This  is  due  to  the  existence  and  uniqueness  of  the  solution 
to  the  delay  equation  (in  our  case  (5.1))  and  its  continuous  dependence  on 
the  initial  function  (in  our  case  (5.2)).  Correspondingly,  we  may  define  the 
state  of  system  (5.1)  at  time  t  i  o  to  be  the  triple. 

x(t)  -  (x(t),xt>ut)  £  X 

and  analogously,  the  state  of  the  transposed  system  (5.3)  at  time  t  i  o 
will  be  given  by 

— ,z(t)  -  (z(t >,*t,vt)  £  XT- 

The  idea  of  including  the  input  segment  in  the  state  of  the  system  was  first 
sugge  *d  by  ICHIKAWA  [22] ,  [23] . 

In  order  to  describe  the  duality  relation  between  the  systems  (5.1)  and 
(5.3),  we  need  an  alternative  state  concept.  For  this  we  replace  the  initial 


functions  $  and  4  of  the  state-  and  input-  variables  by  additional  forcing 
terns  of  suitable  length  on  the  right-hand  side  of  both  equations  in  (5.1). 
These  terns  completely  determine  the  future  behaviour  of  the  solution  and  the 
output.  More  precisely,  we  rewrite  system  (5.1),  (5.2)  as 


(5.5;  1)  x(t)  -  dn(t)x(t-r)+  dB(r)u(t-r)  ♦  fl(t),x(o)  -  f°, 

-'o  *  O 

(5.5; 2)  y(t)  -  f  dy (t)x(t-r)  ♦  f2(t),  t  i  o 
Jo 

where  the  triple 

f  -  (f°,fl,f2)  e  ^  -  IE."  x  L2 [0,h;  R."]  x  L2[0,h;  RP] 

is  given  by 

(5.6;1)  «°  - 

h  h 

(5.6;2)  f1(t)  -  ]  dn(x)*1(t-r)  ♦  f  dB(xH2(t-T), 

(5.6;3)  f2(t)  -  j  dY(T)*X(t-T),  0  S  t  f  h 


Remarks  5.1 

(i)  The  expressions  on  the  right-hand  side  of  (5.6;2)  and  (5.6;3)  are  well 
defined  as  square  integrable  functions  on  the  interval  [o,h]  (see  e.g. 
DELFOUR-MANITIUS  [19]  or  SALAMON  [40]  ).  Each  of  them  can  be 

interpreted  as  the  convolution  of  a  Bore 1-measure  on  the  interval  [o,h]  with 
2 

an  L  -function  on  the  interval  [-h,o]. 


(ii)  The  product  spece  x  L2(o,h;  \E.”)  x  L2(o,h;  |>.P)  can  be 

identified  with  the  dual  space  of  "  |E.  x  L2(-h,o;  J^#)  x  L2(-h,o;  ) 

via  the  duality  pairing 
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*oT  f°  ♦ 


"  T  h  T 

|  (-8)f1(s)ds  *  J  *2  (-s)f2(s)ds 


T  T* 

for  »  £  and  f  £  •  In  Che  same  manner  we  can  identify  Che 

produce  space  5£  *  -  x  L2(o,h;  BL  )  x  L2(o,h;  Ifc.* )  with  Che  dual  space 
of  ^  -  lXa  x  L2(-h,o;  It")  x  L2(-h,o;  ft."'). 

Now  ic  is  easy  Co  see  chat  Che  solution  x(t)  and  the  output  y(t)  of 
system  (S.S)  vanish  for  t  i  o  if  and  only  if  f  ■  o.  This  fact  motivates 
the  definition  of  the  initial  state  of  system  (S.S)  to  be  the  triple  f  €  36 
Correspondingly  the  state  of  (S.S)  at  time  t  j  o  is  the  triple 

i(t)  -  (x(t),xt,yt)  &  XT* 

where  the  function  components  xC  £  L2(o,h;  |j(.n)  and  yl  £  L2(o,h;  J^P)  are 
the  forcing  terms  of  system  (S.S)  after  a  time  shift.  These  are  given  by 


(5. 7; 1)  x 


C(s)  -  | 


dn(T)x(t+s-x)  ♦  dB(i)u(t***s-T>  ♦  f  (t+s)  , 


(5 . 7 ; 2)  yC(s)  -  |  dy(T)x(t+s-T)  +  f2(t+s),  o  f  s  S  h, 

s 

12  / 
where  f  (t)  and  f  (t)  are  defined  to  be  zero  if  t  e  [o,h] . 

The  idea  of  defining  the  state  of  a  delay  equation  through  the  forcing  term 
rather  than  the  solution  segment  was  first  suggested  by  MILLER  [37]  for 
Volterra  integro-dif ferential  equations.  The  corresponding  duality  relation 
has  been  discovered  by  BURNS  and  HERDMAN  [  6 ] .  Further  references  in  this 
direction  can  be  found  in  SALAMON  [40] . 

The  same  ideas  as  above  can  be  applied  to  the  transposed  equation  (5.3). 
For  this  we  rewrite  system  (5.3),  (5.4)  in  the  following  way. 
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£ 

(5.8; 1)  i(t)  -  [  dnT(T)*(t-T)+  [  dyT(T)v(t-r)*gl(t),  z(o)  -  g°, 

•  a  in 


'O 
C 

(5 . 8 ; 2)  w(t)  «  |  d6T(t)z(t-0  *  g2(t),  t  i  o. 


when  the  triple 

8  *  (g0.*1.*2)  3C-*  *  *  l*2(o,h;tfLn)  x  L2(o,h; 

is  given  by 

(5.9;1)  g°  -  if0, 

h  h 

(5.9;2)  g1(t)  -  [  dnT(T)(i1(c-T)  ♦  f  dYT(T)p2(t-T>, 

Jt  't 

h 

<5.9;3)  g2(t)  -  f  d8X(T)^l(t-T),  o  s  t  S  h. 

’  t 

The  initial  state  of  system  (5.8)  is  the  triple  g  L  X*  and  the  state  at 
time  t  i  o  is  given  by 

*(t)  -  *(t),*t,vt)  4  X* 

a  2  n  a  J  Q 

where  the  function  components  z  fc  L  (o,h;  tfc,  )  and  w  fc  L  (o,h;  ) 

are  of  the  form 


t+s 


t+s 


(S.10;l)  zt(s)  -  |  dnT(T)z(t+s-i)  ♦  |  dYT(t)v(t+s-T)  ♦  gl(t*s). 


t*s 


(5. 10; 2)  wt(s)  •  j  dBT(T)z(t*s-r)  ♦  g2(t+s). 


o  S  s  S  h  . 


These  expressions  can  be  obtained  from  equation  (5.8)  through  a  time  shift. 

Sianarising  out  situation,  we  have  introduced  two  different  notions  of 
the  state  both  for  the  original  RFDE  (5.1)  and  for  the  transposed  RFDE  (5.3). 
A  duality  relation  between  these  two  equations  involves  both  state  concept. 
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The  dual  state  concept  (forcing  terms)  for  the  original  system  (5.1)  is  dual 
to  the  'classical'  state  concept  (solution  segments)  for  the  transposed 
system  (5.3).  More,  precisely,  we  have  the  following  result. 

Theorem  5.2  Let  u(.)  fc  (o,«;  |fc.B)  and  v(*)  e  L^  (o,»;  (£,**)  be  given. 

loc  loc 

T*  T 

(i)  Let  f  £  jfe.  and  ifi  £  •  Moreover,  suppose  that 

s  t  t  T* 

x(t)  ■  (x(t),x  ,y  )  6  is  the  corresponding  state  of  (5.5)  with  output 

y (t)  and  that  z(t)  -  (z(t),z  ,v  )  6  is  the  state  of  (5.3),  (5.4)  at  time 

6  t 

t  i  o  with  output  w(t).  Then 


<*,x(t)>  _*  -<Z(t),f>  * 

*T.3fcT  itT.  3tT 


t  t 

•  |  wT(t-s)u(s)ds  -  |  vT(t-s)y (s)ds. 


(ii)  Let  ♦  £  X.  and  J  tX*.  Moreover,  suppose  that  x(t)  »  (x(t),xt>ut) 
is  the  corresponding  state  of  (5.1),  (5.2)  with  output  y(t)  and  that 

«  £  £  it 

z(t)  “  (z(t),z  ,w  )  €  is  the  state  of  (5.8)  at  time  t  >  o  with  output. 
w(t) .  Then 


*  -  <z(t),*>  . 

3 e  .x  * 


■  |  wT(t-s)u 


(s)ds  -  v  (t-s)y(s)ds,  t  i  o 


Proof  We  will  only  give  a  proof  of  statement  (i).  For  this  let  us  assume 
that  z(t),  t  3  -  h,  is  the  unique  solution  of  (5.3),  (5.4)  with  output  w(t), 
t  i  o,  and  that  x(t),  t  i  o,  is  the  unique  solution  of  (5.5)  with  output 
y(t),  t  i  o.  Moreover,  let  x£  €  L^[o,h;|^1'],  yC  t  L^[o,h;  be  given 

by  (5.7)  end  define  x(t)  ■  o,  u(t)  ■  0  for  t  <  o.  Then  it  is  easy  to  see 
that 

t 

j  (*T(t-s)Lx#  -  [LTzt_#]Tx(s))ds 
o 
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*  (-s)dn(T)x(t+s-t)ds 


and  analogous  equations  hold  for  B  and  C.  Moreover 


♦°*  x  (e)  -  *T(t)f°  -  f  ~  sT(t-s)x(s)ds 

'o 

t  t 

|  **(t-s)x(s)ds  -  j  *T(t-s)x(s)ds 


This  taplies 


A  -  <-£.(t),f>  T* 

x \  X  3t .  3e 


.OT  .  .  T,  wo 
•  <i  x(c)  -  x  (t)f 


f  ♦lT(-s)xt 

*  n 


(s)ds  ♦  I  i(i2T(-s)yt(s)ds 


h  h 

-  [  2T(t-s)f1(s)ds  -  [  vT(t-s)f2(s)ds 

Jo  J0 

e 

■  I  **(c-s)  [Lx  ♦Bu  +f*(s)]  ds 
'  o 

t  h-t 

-  |  [LTzt#  +  CTvt_#]T  *<*>ds  *  |  *1T(-a)£1Ct+s)ds 


U  ♦”<- 


s)dn(T)x(t+s-T)ds  +  <>  (-s)dS(t)u(t+s-T)ds 


♦  [  I  *2T(-s)dY(T)x(t+s-T)ds  +  [  *2T(-s)f2(t+s)ds 


f  h 

-  I  sT(t-s)fl(s)ds  -  [  *1T(t-s)fl(s)ds 

Jo  J t 

*  h 

-  J  vT(t-s)f2(s)ds  -  J  *2T(c-a)f2(s>ds 
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-  j  [BTz  t_s]Tu(s)ds 
t 

”  |  w^(t-s)u(s)ds  - 
o 


2  1 
Cx  ♦  f  (3)  ds 

8  J 


I  vT(t-s)y(s)ds 
'  o 


m 


5.3  Semigroups  and  structural  operators 

Throughout  this  section  we  restrict  our  discussion  to  the  homogeneous 
systems  (S.X)  and  (S.S)  respectively  (3.3)  and  (5.8)  which  means  that  u(t)  -  0 
respectively  v(t)  "  0  for  t  i  o. 

The  evolution  of  the  systems  (S.l)  and  (5.3)  in  terms  of  the  ’classical* 
state  concept  (solution  segments)  can  be  described  by  strongly  continuous 
semigroups 

J(t)  :  X  -  X  .  $V)  :  *  XT. 

The  semigroup  ^  (t)  on  36.  associates  with  every  0  fc  56  the  state 
3  (t)<*>  -  x(t)  -  (x(t),xt,ut)  fe  X 

of  (5.1),  (5.2)  at  time  t  i  o  which  corresponds  to  the  input  u(s)  «  o,  s  j  o. 
Its  infinitesimal  generator  is  given  by 


fi(d)  -{*  eXU1  fe  w1,2(-h,0;  w1,2(-h,0  «.”)(>%1(o),«2(o)  -  0} 

0,4  •  (Ml+B*2,il,i2) 

(S ALAMO X  [  *h>  ,  Theorem  1.2.6]).  The  semigroup  £  *(t)  is  defined  analogously 
and  generated  by  the  operator 


2  <(XT>  ‘  «XT|X'1feW1,2(-h,o;  Ig")  *2  6  Wl*2(-h,o;  fcP); 

'  ,0  _  .1 


*°  ■  *X(o),*2(o)  -  0) 


07*  ■  aV+cV,*1,*2). 

An  interpretation  of  the  adjoint  semigroups  ^**(t),  2^*  and 

£  (t):  36  *36  can  be  given  through  the  dual  state  concept  (forcing  terms) 
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for  th«  systems  (5.1)  and  (5.3).  Mors  precisely,  we  have  the  following 
result  which  is  a  direct  consequence  to  Theorem  5.2. 


Corollary  5.3 

(i)  Let  f  £  be  given  and  let  x(t)  -  (^(O.x^y1)  tf  X**  be  th*  *t*t« 

of  system  (5.5)  at  time  t  J  o  corresponding  to  the  input  u(*)  5  0.  Then 
x(t)  -  $T*(t)f. 

(ii)  Let  g  €  X*  be  given  and  let  z(t)  *  (z(t),zt,wt^£  X  *  be  the  state 
of  system  (5.8)  at  time  t  J  o  corresponding  to  the  input  v(«)  =  0.  Then 
z(t)  -  S  (*)g- 

Our  next  result  is  an  explicit  characterization  of  the  infinitesimal  generators 
and  Cl  of  the  semigroups  •$  T  (t)  and  ^  (t). 

Proposition  5.4 

(i)  Let  f,  d  £  X**  be  given.  Then  f  t  $  (  QiJ* )  and  Q,T  f  •  d  if  and 

only  if  the  following  equations  hold 

h 

(5. 11 ;  1)  n(h)f°  -  d°  +  [  dl(s)ds, 

'  o 

h 

(5 . 1 1 ;  2)  fl(t)  ♦  [t)(t)-ri(h)]f0  -  -  |  d1  (s  )ds ,  ojtsh, 

> 

(5. 11;  3)  f2(t)  ♦  [Y(t)-y(h)]f°  -  -  d2(s)ds,  oitfh. 

>  t 

(ii)  Let  g,  k  £  X*  be  given.  Then  g  t  £)  ( Cl  *)  and  Q,  *g  -  k  if  and 
only  if 


h 


(5.12; 1) 

nT(h)g° 

-  k°  ♦  [  k1(s)ds 
'0 

h 

/  % 

(5.12-.2) 

g*(t)  ♦ 

[nT(t)-nT(h)]g°  -  - 

x  (s)ds,  o  f  t  *  h, 
;t 

h 

(5.12;3) 

g2(t)  ♦ 

lBT(t)-8T(h)]g°  -  - 

I  k2(s)ds,  o  f  t  S  h. 
'  t 
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Proot  Obviously  ic  is  enough  to  prove  statement  (i).  First  note  that 
£  t.  5  (  CC  )  and  Q,  f  ■  d  if  and  only  if  <^td>  »  <  Cl  ^f£>  for  every 
♦  V  £)  (  aT).  Hence  statement  (i)  is  a  consequence  of 
h  h 

<*.d>  -  *°V  ♦  *1T(-S)d1(s)ds  ♦  f  *2T(-s)d2(s)ds 

'  o  *  o 

h  h  h 

“  <»^^(o)(d0  +  I  d2(s)ds]  -  f  i1T(-t)  [  d2(s)dsdt 
>o  > o  't 

h  h 

-  [  i2T(-t)  [  d 


and 


d  (s)dsdt 


<  aTM> 

h 


■  f  if'^C-TjdniTjf0  +  [  l|)2T(-T)dY(T)f° 

O  >0 

rh  h 

♦  I  i1T(-s)f1(s)ds  ♦  [  i2T(-s)f2(s)ds 
'  o  *  o 


-  H»1T(-h)n(h)f°  +  *2T(-h)Y(h)f° 


h  h 

«)n(s)£”ds  ♦  J  i“(-s)y(s)f°ds 

'  n 


+  f  ^  I  *.2T  f _ \^.  t  -  \  «0 

Jo  'o 


♦  |  *1T(-s)fl(s)ds  +  |  i2T(-s)f‘(s)ds 

O  o 

h 

-  *1T(0)n(h)f°  ♦  I  i1T<-*> [f 1 

)  o  ■ 

h 

♦  [  i2T(-s)[f2(»)  ♦  y(s)f°  -  Y(h)f°]ds.  IZZ3 

'A 


(8)  ♦  n(s)f°  -  n(h)f°]ds 
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The  duality  relation  between  the  systems  (S.l)  and  (5.3)  can  now  be 
described  through  the  following  four  semigroups 

J(t)  :  -  3*.  .  4T(t)  :  3CT  -  T. 

T‘(t)  :  £T*  -  XT*  •  3V)  :  X*  * 

The  semigroups  on  the  left-hand  side  correspond  to  the  RFDE  (5.1)  and  those 
on  the  right-hand  side  to  the  transposed  RFDE  (5.3).  On  each  side  the 
upper  semigroup  describes  the  respective  equation  within  the  'classical' 
state  concept  (solution  segments)  and  the  semigroup  below  within  the  dual 
state  concept  (forcing  terms).  A  diagonal  relation  is  actually  given  by 
functional  analytic  duality  theory. 

The  relation  between  the  two  state  concepts  can  be  described  by  a  so-called 
structural  operator 

which  associates  with  every  $  <  3C  the  corresponding  triple 
(5.13)  'J*  -  f  €■  2eT*  given  by  (5.6)). 

It  is  easy  to  see  that  this  operator  maps  every  state  x(t)  €.  of  system 

2  T* 

(5.1)  into  the  corresponding  state  x(t)  6.  "36  of  system  (5.5)  which  is 

given  by  (5.7)  and  (5.6).  This  fact  together  with  corollary  5.3  shows 
that  the  following  diagram  conmutes 
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Another  important  fact  is  chat  the  adjoint  operator  :  ot  ^  3E  * 

plays  the  same  role  for  the  transposed  RFDE  (5.3)  as  the  structural  operator 
*2  :  ■*  Tfc.  T  does  for  the  original  RFDE  (5.1).  These  properties  are 

susssarized  in  the  theorem  below. 

Theorem  5.5 

«>  ’3iu>-  s1*^.  a*  i'o’a* 

(ii)  If  *  fc  (Q.),  then  ^  ♦  e  $  (CiT*)  and 

aT*  ^ 

(iii)  If  i  e  ^  (  U.T),  then  ^  *  i>  (,  ^)  (  Ct  )  and 

Ol*  OtV 

(iv)  The  adjoint  operator  3  !  at”1  ■*  3L*  maps  every  fe  3£T  into 

the  triple  ^  *  "  8  €.  which  is  given  by  (5.9). 

Proof  Statement  (i)  follows  from  the  above  considerations,  the  statements 
(ii)  and  (iii)  are  immediate  consequences  of  (i)  and  statement  (iv)  can  be 
proved  straight  forwardly.  l/>  H 

A  structural  operator  of  the  above  type  has  first  been  introduced  in 
BERNIER-MANITIUS  [4],  DELFOUR-MANITIUS  [19]  for  retarded  systems  with  state 
delays  only  and  later  on  by  VINTER-KVONG  (4l],  DELFOUR  [ 16]  for  RFDEs  with 
delays  in  the  state  and  control  variables.  An  extension  to  neutral  systems 
can  be  found  in  SALAMON  [  4,0]  . 


5.4.  Abstract  Cauchy  problems 

In  order  to  describe  the  action  of  the  output  operators  for  the  RFDEs 
(5.1)  and  (5.3)  -  each  within  the  two  state  concepts  of  section  5.2  -  we 
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Introduce  the  following  four  subspaces 


VO  ■(♦<X|*14  W1,2(-h,o;  ■  ^(o))  . 

U)T  -  (1>  fc  K1!*1  fc  Wl»2(-h.o;  fc"),*0  "  <'1(o)>  • 
y1*  -  {ft  XT*lf2(->*Y<-)f°fc  W1,2(o,h;fc.P),f2(h)  -  o>  . 

TJ*  -  (g  £  3L*|g2(-)  +  8T(.)g°6  W1*2(o,h;  d“),g2(h)  -  o}. 

These  have  the  following  properties. 

Remarks  5.6 

(i)  The  subspaces  >1 .  -vl*.  and  "0*  are  dense  in  X  ,  =£*»  3 1? 

and  "3C  *»  respectively.  Moreover,  oO  and  ^  become  Hilbert  spaces  if 
they  are  endowed  with  the  norms 

o  o 

I!  ♦II2.  -  |U°||2  ♦  f  If  ♦ 1  (r ) ||  2  dT  ♦  [  If  ♦  2(x ) || 2  dr.d  e  w  , 

vc  -h  r  hi  «r 

h 

llfll2  -  llf°l|2  ♦  f  II  *x<«)|l 2  d. 

DT*  0  *n 

h  2 

♦  [  ||  £  [f2(»)  ♦  Y(«)*°]|l  „  da.  f  6 

Jo  S? 

Topologies  on  bC>T  and  'O  can  be  defined  analogously. 

(ii)  The  dual  spaces  T)  >  Tf  and  Vi*  are  extensions  of 

3£,  XT,  X^nd  X*.  respectively.  Thus  we  obtain  the  inclusions 

-v)c  X.  C  IT,  iiT  C  3£t  CDt, 

c  XT*  c  %0T\  -0*  CX  C Vi*' 
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with  continuous,  dense  embeddings. 


(iii)  It  is  easy  to  see  that  $  (h)  *  i  Ofe 

£T(h)  ef(£.T,O0T),  XT*(h)  e  £<2***.  n)T*)  «nd 

£  (h)  €  3^  (  j£*»  *0  *)•  By  duality,  we  obtain  £  (h)  fe  f("0,3d) 

iT(h)  el(2;T.  Kt),  I*oo«f<tf.**) 

Before  introducing  the  input  -  and  output  -  operators,  we  prove  that 
the  spaces  “Vi  ,  ”"0  T,  ^  T'  and  l)  are  invariant  under  the  semigroups 
"S  (t)>  T(f)t  (t)  and  (t),  respectively.  For  this  we  neid 

the  following  preliminary  result. 


Lemma  5 . 7  Let  f  £  *0  T*  be  given  and  let  d  £  L2(o,h;  satisfy 

h 

f2(s)  +  [y(s)  -  y(h)]f°  -  -  |  d(o)do,  o  t  s  f  h. 

s 

Moreover,  let  x(-)  £  W1,2(o,t;  nLn)  he  chosen  such  that  x(o)  -  f°  and  let 
yC  €  L2(o,h;  tH.P)  be  defined  by  (5.7;2).  Then 


yc(s)  ♦  hr(s)  -  y (h) ]  x(t) 
h  t+o 

-  -  |  [  |  dY(t)x(t+o-T)  ♦  d(t*o)]da  ,  o  S  s  S  h  • 

*  o 

Proof  Let  us  define  x(s)  ■  f°  for  s  So  and  d(o)  “  0  for  o  ^  [o,h]. 

Then  the  equation 
h 

|  dY<i)x(t+s-T)  -  [Y<h)-Y(t*s)]f° 
t+s 

holds  for  all  t,s  i  o.  This  implies 
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r 


h  t+° 

|  {  |  dY(x)x{t+c-x)  ♦  d(tx«)]da 


■  a 

h  h 


h-c 


■  I  dy(x)x(t+o-x)do  *  d(t*o)do 
'  *  'a  { 


h  t  h 

x ( t+o—T }ds  |  d(o)do 
t+s 
h 


“  >  n 

■  |  dy(x)  |  x(t+o-x)ds  ♦  | 


-f. 


dy(x)  [x(t)-x(t+s-x)]  -  £  (t*s) 


[y(t>»)  -  y  (h)]£ 


t+s 


“  [y(h)  -  y(s)]  x(t)  -  |  dy(x)x(t+s-x)  «■  f2(t+s) 

s 

-  -  yr(«)  -  [y(«)  -  y(h)]x(t).  l£Z3 

Now  wc  are  in  Che  position  to  prove  Che  desired  invariance  properties 
o£  the  subspaces  TO  ,  "VO”1,  l)  T  end  ~U  *. 

Proposition  5.8 

(i)  (t)  is  a  strongly  continuous  semigroup  on  T\)  and  \)  . 

(ii)  S  T(t)  is  a  strongly  continuous  semigroup  on  T^T  and  "\)  T. 

<iii)  ^**(0  is  a  strongly  continuous  semigroup  on  T)  T*  and  ^0  T*. 

(iv)  $  (t)  is  a  strongly  continuous  semigroup  on  "l)  *  and  TO*. 

(v)  3  fc  i(«0.T)T*)  and  3  <f<  T?.,T0T*). 
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<vi)  *  6.  &  (^T,  l)  *)  and  g  *4  ^(*0T.  “V)  *) , 


Proof 


First  note  that  every  eolution  x(t)  of  (5.5)' £s  absolutely 


•  z 

continuous  for  t  3  o  and  that  its  L  -derivative  depends  continuously  on 
4  6  ^£,T  (SALAMON  [40  ,  Theorens  1.2.3  (i)].  This  shows  that  £  (t)  is  a 
strongly  continuous  semigroup  on  *)\)  . 

Now  let  f  t  V  1  be  given  and  let  x(-)  6  w|’*(o,«>;  |J^n)  be  the 

loc 

corresponding  solution  of  (5.5)  with  u(t)  =  o.  Moreover  let  y(t),  t  >  o, 
be  the  output  of  (5.5)  and  let  xC  and  yfc  be  given  by  (5.7).  Then 

£  T*(t)f  “  (x(t),xt,yt)  (Corollary  5.3)  and  hence  it  follows  from  Leona 

.p  x*  _  i  T* 

5.7  that  the  function  t  — ►  4  (t)f  is  continuous  with  values  in  i) 


and  depends  in  this  space  continuously  on  f  t  "V 


T* 


The  same  considerations  -  applied  to  the  transposed  system  (5.3)  -  show 
that  J*T(t)  is  a  semigroup  on  T  and  that  £  *(t)  is  s  semigroup  on 

iT  .  The  remaining  assertations  in  (i),  (ii),  (iii)  and  (iv)  follow  by 
duality. 

In  order  to  prove  (v)  and  (vi),  let  ♦  t  'VO  be  given.  Then  Lemma  5.7  - 
applied  to  f  •  o,  t  -  h,  and  x(s)  ■  ♦1(s-h)  for  o  i  s  $  h  -  shows  that 
*3  ♦  6.  3£T  satisfies  the  equation 

[  ^  ♦  ]2(s)  +  [y(s)  -  T<h)][g*J° 


h  h 


-u 


dy(r)$  (o-r)do, 


o  $  s  $  h  . 


s  o 


Hence  ^  $  is  in  "VT  and  depends  in  this  space  continuously  on  $  e  "Vi  . 
We  conclude  that  ^  fe  )•  The  remaining  assertions  of  (v)  and  (vi) 

follow  from  this  fact  by  analogy  and  duality.  l/'/'A 


Now  let  us  introduce  the  output  operators 

f  :  ”>0  -  .  flT  :  »T 


K"  . 


f :  -t;1* 


P  *  :  V*  *  -  IK"  . 
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by  defining 


h 

£  ♦  ■  J  dYOO^i-T), 

^0 

♦  ft  ^ 

h 

JBT*  -  [  dgT(T)ltll(-T), 

1  o 

* 

f  ^f  -  f2(o)  , 

f 

Q  *8  "  82(o)  , 

g  £V“*. 

Then  the  adjoint  operators 

B  ■  R.‘-  v  . 

t  '•  *P  -  • 

B1*  ■  IR"  -*  -Hi1*  • 

f  :  1RP  - 

describe  Che  input  action  for  the  systems  (5.1)  and  (5.3).  More  precisely, 
we  have  the  following  result  for  the  RIDE  (5.1).  The  corresponding  statements 
for  the  transposed  RFDE  (5.3)  can  be  formulated  analogously. 

2  Q 

Theorem  5.9  Let  u(*)  t  L  (o,«;  B  )  be  given 
-  loc  ' 

(i)  Let  d  ft  and  let  x(t)  6  be  che  corresponding  state  of  (5.1), 

(5.2)  at  time  t  i  o.  Then  x(t),  t  J  o  ,  is  a  continuous  function  with 

values  in  *w)  and  depends  in  this  spece  continuously  on  M  and 
2  m 

u(*)  i  L  (o,»;  )  .  Moreover 

loc 

t 

(5.14;  1)  x(t)  -  $  (t)d  +  |  <t_»>  £u(s)ds,  t  i  o, 

•  o 

where  che  integral  is  to  be  understood  in  the  Hilbert  space  IT  .  The  output 
y(t)  of (5.1) is  given  by 

(5.14;2)  y (t)  x  (t),  t  i  o  . 

(ii)  Let  f  ft  T)T*and  let  x  (t)  £  be  the  corresponding  state  of  (5.5) 
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at  tine  t  i  o.  Than  x(t),  c  }  o,  i«  a  continuous  function  with  values 

in  and  depends  in  this  space  continuously  on  f  6.  *)) T*  and 

u(-)  i  L2  (©,«■;  |Pm).  Moreover 

loc 

t 

<5 . 15 ;  1 )  x (t)  -  ^(Of  ♦  J  ,JT*(t-s)  ^T*u(s)ds,  t  i  o 

'  o 

vhara  the  integral  is  to  be  understc.J  in  the  Hilbert  space  TO  .  The 
output  y(t)  of  (5.5)  is  given  by 


(5.15;2)  y(t)  -f1*  J(t),  t  > 


Proof  If  u(-)  =  o,  then  the  statements  of  the  theorem  follow  immediately 
from  Proposition  5.8  (i),  (iii)  together  with  the  definition  of  the  operators 

v)  TS 

C  and  Q  .  So  we  can  restrict  ourselves  to  the  case  $  “  o  and  f  ■  o. 

First  of  all,  the  same  arguments  as  in  the  beginning  of  the  proof  of 
Proposition  5.8  show  chat  x(t)  is  continuous  with  values  in  ^0  and  depends 

2  IB 

in  this  space  continuously  on  u(>)  t  L^oc(o,»,  IE.  ).  Secondly,  we  establish 

.  A  *  * 

equation  (5.14;1).  For  this  let  g  £  U  be  given,  let  z(t)  fe  X.  be  the 
corresponding  state  of  (5.8)  with  v(.)  =  o  and  let  W (t),  t  }  o,  be  the 
output  of  (5.8).  Then  z(t)  -  (t)g  £  (Corollary  5.3  and  Proposition 

5.8  (iv))  and  w(c)  -  Q  z(t),  by  definition  of  Che  operator  3  .  Hence 
it  follows  from  Theorem  5.2  (ii)  that  Che  following  equation  holds  for  every 
t  i  o 


<g.x(c)> 


-  <S.*<t)> 


* 


•1 

c 

I 

-J 


w  (t-s)u(s)ds 


<BT  (t-s)g,u(s)»  a  ds 

g 
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t 

-  <g,  I  f  (t-s)  J)  u(s)ds> 

°  v.v- 

This  proves  statement  (i). 

Nov  recall  Chat  x(t)  “  ;fx(t)  aa  long  as  f  ■  o  and  $  ■  o.  Hence  it 

follows  from  (i)  and  Proposition  5.8  (v)  that  x(t),  t  i  o,  is  continuous 

with  values  in  and  depends  in  this  space  continuously  on 

2  nm 

u(-)  €  L  (o,«j  IK.  )•  Finally,  equation  (5.15;1)  can  be  established  in  an 
loc 

analogous  sianner  as  (5.14;1)< 

The  previous  theorem  shows  that  the  evolution  of  the  state  x(t) 
of  the  RFDE(5.1)  in  terms  of  the  'classical'  state  concept  can  be  formally 
described  through  the  abstract  Cauchy  problem 

x(t)  -  (X  x(t)  8  u(t),  x(o)  - 

l 

y(t)  -  ^  x(t), 

in  the  Hilbert  space  Tv)  respectively  T)  . 

*  TA 

Analogously,  the  state  x(t)  €  3C  of  equation  (5.5)  in  terms  of  the 
dual  state  concept  defines  a  mild  solution  of  the  abstract  Cauchy  problem. 


*<t)  -  CL1"  +  S^uCt),  x(o)  -  f. 


.T* 


rT* 


y(t)  -  '£>T*  x(t). 


in  the  Hilbert  space  **  respectively  Tv)**. 


If  ve  consider  the  Cauchy  problem  t  (respectively  £  )  in  the  smaller 

state  space  (respectively  "V  T  ),  then  the  output  operator  ^  (respectively 
)  will  be  bounded  and  the  input  operator  (5  (respectively  3^  )  unbounded. 
Nevertheless,  the  solution  of  Z  (respectively  £**)  in  the  state  space  T\) 
(respectively  T)**)  is  well  defined,  since  the  input  operator  satisfies  the 
hypothesis  (HI)  of  Section  2.  More  precisely,  the  operator  (respectively 
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T* 

ft  )  Has  Che  following  property  which  follows  directly  from  Theorem  5.9. 

Remark  5.10 

For  every  T  >  o  there  exists  some  constant  >  o  such  that  the  inequalities 
T 

||  f  j*<T-s)  8u(.)ds||  S  b  ||  u(*)|| 

O  TO  L2(o,T;  ft.®) 

T 

Ilf  S  T*(T~s)  j^T*u(s)ds||  S  b  |I  u(-)  || 

0  V1*  L2(o,T;«.B) 

hold  for  every  u(-)  L2(o,T;  ft.®). 

If  we  consider  the  Cauchy  problem  I  (respectively  I1*)  in  the  larger 
space  U  (respectively  10  ),  then  the  input  operator  will  be  bounded 

and  the  output  operator  unbounded.  Nevertheless,  the  output  of  the  system 
is  well  defined  as  a  locally  square  integrable  function  since  the  output 
operator  satisfies  the  hypothesis  (H2)  of  Section  2.  More  precisely,  the 
operator  ^  (respectively  )  has  the  following  property. 


Remark  5.11  For  every  T  >  o  there  exists  some  constant  c^  >  o  such  that 


the  inequalities 

II  (•)♦!! 


L2(o,T;  *?> 


*  cT  II  * 


V 


ii 


S  cT  II  f  I 


"Hi 


T* 


L2(o,T;  fcP) 
hold  for  every  $  C  "O  and  every  f  t 

T 

This  follows  by  duality  from  the  fact  that  the  adjoint  operators  £ 

ip  h 

and  ^  are  the  input  operators  of  the  transposed  equation  (5.3)  and  hence 
satisfy  analogous  inequalities  as  those  in  Remark  5.10. 
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'A.— , 


9 


Now  lot  u*  apply  Theorem  S.9  Co  Che  transposed  RFDE  (5.3).  Than  we 

n  T 

obtain  that  the  state  z(t)  t  X  of  (5.3)  in  terms  of  the  'classical'  state 


concept  defines  a  mild  solution  of  the  Cauchy  problem 

T  *(t)  -  &Tz(t)  +  £Tv(t),  z(o)  -  *, 

1 

w(o  -  3Ti(o 

T  T 

(to  be  considered  in  the  Hilbert  spaces  /V0  and  V  )  whereas  as  the 

2  A 

state  *(t)  t  )(  of  (5.8)  in  terms  of  the  dual  state  concept  defines  a  mild 
solution  of  the  Cauchy  problem 


l 


w(t) 


0-  *(t)  *  £*v(t),  z(o)  -  g, 

£*t<c) 


(to  be  considered  in 
Summarizing  our 


the  Hilbert  spaces  'V  and  7^  ). 

situation  we  have  to  deal  with  the  four  Cauchy  problems 


E 


Z 


T 


T* 


* 


£ 


These  are  related  in  the  same  manner  as  the  semigroups  J^(t),  ^T(t),  T  (c)  and 
(t).  More  precisely,  the  Cauchy  problems  on  the  left-hand  side  corresponds 
to  the  RFDE  (5.1)  and  those  on  the  right-hand  side  to  the  transposed  RFDE  (5.3). 
On  each  side  the  upper  Cauchy  problem  describes  the  respective  equation  with 
the  'classical'  state  concept  (solution  segments)  and  the  Cauchy  problem 
below  within  the  dual  state  concept  (forcing  terms).  A  diagonal  relation  is 
actually  given  by  functional  analytic  duality  theory. 

The  vertical  relations  between  the  four  Cauchy  problems  above  may  also 
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b«  described  through  the  structural  operators  and  3  *.  In  particular, 
it  follows  from  Theorem  5.9,  that  x(t)  -  ^  x(t),  t  >.  o,  defines  a  mild 

X* 

solution  of  £  if  x(t),  t  )  o,  is  a  mild  solution  of  £.  This  fact  is  also 
a  consequence  of  Theorem  5.5  together  with  the  following  relations  between 

the  various  input/output  operators  by  means  of  the  structural  operator  3  . 

Proposition  5.12 

s’*  -  SB.  $*.  v  eT 

*  -  ?T*3.  f!T-  B*  3 " 

Proof  Let  us  firsc  consider  as  *n  operator  from  X)  into  ”[)  1 
(Proposition  5.8)  and  let  9  « *V0  .  Then  ^  ♦  6  and 

h 

£T*3*  -  139]2(o)  -  |  dy(T)91(-T)  -Co1-  £  ♦. 

The  equation  -  fi  3  can  be  established  analogously  by  the  use  of 

Theorem  5.5  (iv)  and  the  remaining  assertions  of  the  proposition  follow  by 
duality.  £22 

T  T*  * 

Finally,  note  that  the  Cauchy  problems  £,  £  ,  £  and  £  may  also  be 

understood  in  a  strong  sense.  In  particular,  if  0  6  and 
2  18 

u(«)<  L  [<>,•;  R.  ] ,  then  it  can  be  shown  that  the  corresponding  mild 
solution  x(t)  of  £  is  in  fact  a  strong  solution.  This  means  that 
x(t),  t  i  o  ,  is  a  continuous  function  with  values  in  Ov  •  that  its 
derivative  exists  as  a  locally  square  (Bochner  -)  integrable  function  with 
values  in  the  lsrger  space  V*  ,  and  that  the  first  equation  in  £  is 
satisfied  in  the  Hilbert  space  for  almost  every  t  i  o  (SALAMON  [40  , 

Theorem  1.3.4]).  In  order  to  make  this  rigorous,  we  need  the  fact  that 
can  be  interpreted  as  a  bounded  operator  from  to  .  This  means 

that  it  the  domain  of  CL  when  CL  i*  regarded  as  an  unbounded,  closed 
operator  on  ^  . 
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Proposition  5.13 


-  ^(d). 


vT-  ■  v 


X>r  -  i).  T(ClT), 

V 


la1*)-  . 


Proof  First  note  that  ”2.T:  *  f)  „(&^)  C  70  T  and  hence 

-  j£T 

^  Q-  ^  ^  -  3£T*  (see  Remark  2.3) 

Now  let  f  £  *T*  .  Then  £  4  $)  t*{CLT*)  if  and  only  if  the 


map 


v 


*  *  *r  *r*  •  ^  £ 


•»T.-kOT* 


S  T<a’ 


TO 


extends  to  a  bounded  linear  functional  on  But  €  5)  .  T<  CL  ) 


only 


TO' 

if  *le  W  2,2  (-h,o;  (^n),*26  W1,2(-h.o;  #.P).  <j,°  -  <l> 1  (o ) . 


and  ^(o)  -  L1!))1  ♦  CT*2;  and  the  following  equation  holds  for  every 

*  e  i  <  aT> 
tot 


<  aT*,f> 


T 


'TO7,  TO 


j  X* 

7L 


■\ 


,  IT, 


2T, 


♦  (-• Odn(r)£  +  *  (-x)dY  (r)f 


•IT  1 

♦  «|;  (-s)f  (s)ds  ♦ 


I  * 

*  O 


2T(-s)f2(s)ds 


|  .Hi1T(-T)dn(x)f0  ♦  | 


IT, 


(-T)dn(x)f  ♦  ♦  (-s)f  (s)ds 


f  *2T(-s){f2(s)  *  r(s)f°  -  y  (h)f°]ds 

*  A 


(compare  the  proof  of  Proposition  5.4).  The  latter  expression  define! 


if  and 
ip2(o)  -  0, 


a 
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bounded  linear  functional  on  “  C 4>  6  |<i  6.  W  ’  (-h,o;  (^  )  ,  ♦  ■  <»  (o)} 

j  2  P 

if  and  only  if  there  exists  a  d  &  L  (o,h;  )  such  that  the  following 

2  12  p  2 

equation  holds  for  every  i (i  6  W  *  (-h,o;  VrJ  )  satisfying  i(i  (o)  «  o 


Ik 

[  i2T(-s)[f2(s)  ♦  y(s)f°  -  Y(h)f°]ds 

'  O 


r  r  •  r 

-  i<l2T-s)d(s)ds  -  -  i2T(-s)  d(o)dods. 

'  o  '  O  '  s 

T*  r\  *j** 

Thia  is  equivalent  to  f  4  ')Y  .  We  conclude  that  -  4/  _.(  CL  ). 

Analogous  arguments  show  that  r>^‘  -  B  ^(Q.  )•  The  remaining 

W 

assertion  of  Proposition  5.13  follow  by  duality.  I //A 


THE  LINEAR  QUADRATIC  OPTIMAL  CONTROL  PROBLEM 
6.1  The  finite  time  case 

In  the  previous  section  we  have  developed  two  state  space  descriptions 
for  the  RFDE  (5.1).  Moreover,  we  have  shown  that  the  corresponding  Cauchy 
problems  2,  and  c.,  both  satisfy  the  hypotheses  (HI) ,  (H2)  and  (H3)  of  Section 
2  in  suitably  chosen  Hilbert  spaces  (Remark  5.10  and  Remark  5.11).  This 
allows  us  to  apply  the  results  of  Section  2  to  the  RFDE  (5.1)  within  the 
state  concepts  of  Sub-section  5.2  .  For  this  sake  we  consider  the  cost 
functional 

T 

(6.1)  JT(u)  -  ( !|  y(t)  H  +  uT(t)  R  u  (t)]dt 

°  * 

D  mxm 

associated  with  the  systems  (5.1)  and  (5.5)  where  R  &  R.  is  a  positive 
definite  matrix. 


Remarks  6,1  For  simplicity,  we  assume  there  is  no  weight  on  the  final  state 
x(T)  respectively  x(T)  in  the  cost  functional  31j.(u).  Such  a  weight  could 


b«  introduced  by  means  of  a  semi-definite  operator  “Vi* 

leading  to  the  additional  term<x(t),  Q  x(t)>_i  _  in  the  performance  index 

«J^(u).  However,  such  a  term  could  never  be  of  the  form  x  (T)^ox(t)  with 

same  non- zero  positive  semi-definite  matrix  Its"*11  since  the  map 

f  — ►  f°  from  5C  ^  into  ^  n  cannot  be  extended  to  a  bounded  linear 
functional  on  '")^T  • 

The  following  result  is  now  a  direct  consequence  of  Theorem  2.6 
and  Proposition  2.7. 


Theorem  6.2 

(i)  There  exists  a  unique  strongly  continuous  operator  family 

*(t)  4  id/,  1^*).  0  g  t  f  T,  such  that  the  function  ir(t)d  is  continuously 

differentiable  in  *  for  every  6  S  70  and  satisfies  the  equation 


ir(t)$  +  ♦  ir(t)  OL  ♦ 


"(t)  $R~l  P>  *ir(t)d  +  -  0, 


e(T)6  ■  0. 


(ii)  There  exists  a  unique  strongly  continuous  operator  family 
^>(t)  6  0  £  t  £  T,  such  that  the  function  $(t)f  is 

continuously  differentiable  in  for  every  f  £  *V  and  satisfies 
the  equation 


*  aT$><t)f  ♦  jpco  aT*£ 


iT  ^>T*. 


If  (T)f  -  0. 
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(iii)  If  .(t)  fc  £  (V.%V*)  and  If  (t)  £  ('^T\  'viT),  0  g  t  «  T, 

are  the  solution  operators  of  (6.2)  and  (6.3),  then 


(6.4)  »(t)  -  3*  tf(t)3  ,  0  (  t  f  T. 

(iv)  There  exists  e  unique  optimal  control  which  minimizes  the 
performance  index  (6.1)  subject  to  (5.1)  and  (5.2).  This  optimal 
control  is  given  by  the  feedback  control  low 


u(t)  --R_1  *  „(t)  i  (c) 


(6.5) 


-  -  R-1  0  T  $  (t)  x  (t) 

-  -  cog-  i  CO 


Where  r(t)  £  ^  CV»1!*)  and  ?PCt)  €  ^(T^*,  "VO T>  are  given  by 

(6.2)  and  (6.3).  The  optimal  cost  corresponding  to  the  initial  state 

*  t  X  is 


(6.6) 


X_(u)  -  <  «,  *(0)*  >  N, 

T  X  •  3C" 


-  <  f.  tf(o)f  >  ^T*.  ^T 


where  f  -  ♦ 


T* 

6 


is  the  initial  state  of  (5.5.1). 


Proof 

The  statements  (i),  (ii)  and  (iv)  follow  issaediately  from  Theorem  2.6 
and  Proposition  2.7.  In  order  to  prove  (iii),  let  CO  £  £  (*ft  •  V)  )  be 
the  unique  solution  of  (6.3)  and  let  s(t)  <s  'tf.Ojp  be  defined  by  (6.4). 
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Moreover,  let  ♦  6  and  £:  ■  ♦  £  TJT  •  Then  -  since  *  t^.(’7)'T1  ')\i  ) 

Che  function  ir(t)$  -  ^  *  i?(t)f,  0  g  -fc  i  T,  is  continuously  differentiable 

with  values  in^*  and  satisfies  the  following  equation 


§£  *(t)$  +  CL  *  "(O*  ♦  *M(X  * 

-  ir(C)/3  R-1^  *  *  (O*  +  * 

"Sj-9  *  s5(t)f  +  Q.V  ?m*  +  $* 

-9*  y<t)f  >aTiP(t)f  ♦  jpuicJ** 

-  $><e)£TVl$T  ff(Of  +  £T<£*f[ 


(See  Theorem  5.5  and  Proposition  5.12).  Now  statement  (iii)  follows 
from  the  uniqueness  of  the  solution  of  (6.2),  U /A 

Note  that  an  analogous  relation  as  (6.4)  has  been  shown  in  DELFOUR-LEE- 
MANITIUS  [l4]  and  VINTER-KWONG  [4l]  for  RFDES  with  undelayed  input /output  - 
variables . 
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6.2  Scabi  lizability  and  detectability 


In  this  section  we  investigate  the  sufficient  conditions  (H4),  (H5) 

for  the  unique  solvability  of  the  algebraic  Riccati  equation  (Chapter  3)  in 

T* 

the  case  of  the  systems  1  and  £  .  We  will  not  consider  these  hypotheses 

in  their  weakest  form  but  have  a  look  at  the  slightly  stronger  properties 
of  stabilizability  and  detectability. 

Definition  6.3 

(i)  System  £  is  said  to  be  stabilizable  if  there  exists  a  feedback  operator 
Kfe&'V'*  (R.  )  such  that  the  closed  loop  semigroup  <X.  (t)  «  i<v> 

defined  by 


t 

(6.7)  (t)4>  -  S  (O*  ♦  [  3  <£k  (s>*ds 

J o  ^ 

for  t  i  o  and  $  €  ”l)“  is  exponentially  stable, 
x* 

(ii)  System  Z  is  said  to  be  s tabi lizable  if  there  exists  a  feedback 
operator  ')(?*€.  ^  C>J*  ;  )  such  that  the  closed  loop  semigroup 

C  £  (^T*)  defined  by 

^(tx  -  JT*<o. .  [V  T*«-> 

and  f  6  "V^  *  is  exponentially  stable. 


(6.8) 


for  t  i  o 
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Remarks  6.4 


(i)  Note  that  the  integral  term  in  (6.7)  ie  a  bounded  linear  operator 

from  "V  to  "l\)  (Remark  5.10)  and  hence  **  a^*°  *  strongly 

continuous  semigroup  on  and  TO  • 

(ii)  It  follows  from  Remark  (5.6)  (iii)  that  for  every  t  i  h. 

efK(o  e  n  £ oe.^). 

(iii)  The  stability  of  the  semigroup  (t)  is  independent  of  the  choice 

of  the  state  space  *1^"  >  ;£  or  .  In  order  to  see  this,  note  that 

the  operator  ^cl-  (X  -  :  OC)  ■*  ^  provides  a  similarity  action 

between  4^  (t)  fc  <^(%))  and  J>K  (t)  €  £  O^)  if  yU  >  0  is 
sufficiently  large.  Moreover,  it  follows  from  (ii)  that  the  stability  of 

4^  (t)  on  the  Hilbert  space  implies  the  stability  on  and  the 

stability  on  implies  the  stability  on  . 


(iv)  The  same  arguments  as  above  show  that  the  closed  loop  semigroup 

(t)  &  £  CY$  )  can  be  restricted  to  a  semigroup  on  T*  or  r)^~ T* 
and  Chat  its  stability  is  independent  of  the  choice  of  the  state  space 


-  »T*  ^.T*  -.w  T* 

TO  >5fc  or  IT  . 

(v)  Let  X  6  ^(*)0  »  RJ,  )  given  and  define 

(6.9)  X-X^fc  in).  rb>. 

Then  the  following  equation  holds  for  every  t  J  o 
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(6.10)  Jf  £  M  -  ^KT*(£)  %  • 


In  fact,  it  follows  from  Theorem  S.S  and  Proposition  5.12  that  for 
•very  4  feU  the  function  x(t)  «  cf  J^(t)d  £  T*.  t  i  o,  defines 

a  solution  of  (6.8)  with  f  “  ♦ . 

(vi)  Every  ,  l^")  can  be  represented  as 

*»  h 

(6.11)  ”XT*f  “  KQf°  |  K1(-s)f(s)ds  ♦  |  K2(-s)f2(s)ds 

J  O  o 

where  K2(.)  <c  L2(-h,o;  £OXP),  K^-)  W1,2(-h.o;  £.”*")  and  Ko  -  K^o). 

Moreover,  let  us  again  suppose  that  “  ^^*^and  consider  the  control  law 

u(t)  -  i(t) 

h  t 


(6.12) 


-  K^x(t)  +  I  l^s-T)dn(T)x(t-s)ds 


o'o 


h  t 


♦  K2(s-T)dY(T)x(t-s)ds 

'o'  o 


h  x 


■»  j  K1(s-T)d8(T)u(t-s)ds 
o  }o 


for  system  (5.1).  Then  it  follows  from  Equation  (6.7)  and  Theorem  5.9 
that  for  every  solution  pair  x(-)  £  L2  (-h,*»;  fl^n)  n  w  ’  (°*~»  R”)i 


loc '  '  '  •  ■  ■  loc 

u(-)  £  L2  (o,«;  lR.w)  of  (5.1),  (5.2),  (6.12)  the  corresponding  state 


x(t)  ■  (x(t),xe,u£) 6  3t  «t  time  t  J  o  is  given  by 
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K>* 


(6.13)  x(t)  -  (t)* 

By  (6.10),  this  implies  that  x(t)  »  x(t)  (  ^  is  given  by 

(t)  -  cfKT*(t)  3  $  . 

(vii)  If  "X  6  $S'l)‘ •  !5Lm)  i*  given  by  (6.9)  then  the  exponential  stability 

of  cTfrC  ^  on  e9ui-valent  t0  that  of  ^  ^  on  ^  ^  .  In 

fact  ,  it  follows  from  Equation  (6.7)  and  Theorem  5.9  that 

(6.14)  range  cf*1  (h)  C  range  ^ 

and  hence  Equation  (6.10)  shows  that  the  stability  of  Ik  (t)  implies  that 
of  ^^**(t).  The  converse  implication  is  a  consequence  of  the  fact  that 
Jk  (t)d  -  (x(t),xt,uc)  and 

x(t)  -  [  ^(0  3*]°.  u(t)  -  ^\T  »X|<  T  <t)^»  t  i  o, 

for  every  solution  pair  x(t),u(t),  ti-h,  of  the  closed  loop  system  (5.1), 

(5.2),  (6.12)  with  *  &  . 

Having  collected  the  basic  properties  of  the  feedback  semigroups  ^ 

and  ^^^*(t),  we  are  now  in  the  position  to  prove  the  following  stabilizability 
criterion. 

Theorem  6.5 

The  following  statements  are  equivalent. 

(i)  System  Z  is  stabilizable. 

(ii)  There  exists  a  feedback'  operator  "X  )  such  that  the 

closed  loop  semigroup  (t)  6  3^  ("V))  defined  by  (6.7)  for  t  Z  o 

and  6  is  exponentially  stable. 

T* 

(iii)  System  Z  is  stabilizable. 
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k 


■J.*  Q  V 

(iv)  Thera  exists  a  feedback  operator  X  fc  £  ( V  »  Ifi  '  such  that 

the  closed  loop  semigroup  V  Mi  ^(UT*).  defined  by  (6.8) 

T* 

for  t  i  o  and  f  €  'V  is  exponentially  stable. 

(v)  For  every  t  (C  ,  Re  A  a  o, 

rank  fd(X),  g(eX')]  -  n. 


Proof 

The  implications  "(iii)  (i)  (ii)"  and  "(iii)  *♦  (iv)"  follow  from 

Remark  6.4. 


How  we  will  prove  that  (v)  implies  (iii).  Note  that  it  has  been  shown 

in  SALAMON  [  ,  Theorem  5.2.11  and  Corollary  5.3.3]  that  (v)  implies 

the  existence  of  a  stabilizing  control  law  of  the  form  (6.12)  for  the  system 

(5.1)  where  K^(-)  6  W^*^[-h,o;  (o)  and  K^(t)  5  0.  This  means 

that  every  solution  pair  x(t),  u(t),  t  i  -h,  of  (5.1),  (5.2),  (6.12)  with 

♦  i  X  tends  to  zero  with  an  exponential  decay  rate  which  is  independent  of 

4.  This  shows  that  the  semigroup  (t)  is  stable  on  j(£  (Remark  6.4 

\  T* 

(vi))  and  hence  on  (Remark  6.4  (iv)). 


It  remains  to  show  that  (ii)  and  (iv)  imply  (v).  For  this  sake  assume 

that  there  exists  a  X  ^  £  ,  ReXjo,  and  a  non-zero  vector  x  €■  C.  n 

o 

X  T  Xe  \  \  T 

such  that  x  A(X)  »  o  and  x  B(e  ")  •  o  and  define  •  (x  ,  e  ’x  ,0)  e  . 
o  o  o  o 

Then  it  is  easy  to  see  that  Q.  Ti(i  ■  X  i|< ,  ^  T i(>  -  0  and  hence 

Q.  ■  A  ifi,  ■£>  ip  ~  0  (Theorem  5.5  and  Proposition  5.12).  Now 

equation  (6.8)  and  (6.7)  show  that  •  ^T(t)i p  »  e^S  and 

S (t)  3-  *  "  <af  (t)  &  i(/  -  eAt  ij  %  for  every  XT*  i  ;£(  V-1*  »  R.B  ) 
and  every  X  €  3d("W.  ^  )•  Since  ♦  ^  o  and  f  o,  this  shows  that 

(ii)  and  (iv)  are  not  satisfied.  ez2 


The  next  result  is  obtained  by  dualising  Theorem  6.5. 
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Corollary  6.6 

The  following  statements  are  equivalent 

(i)  System  E  is  detectable  in  the  sense  that  there  exists  an  output 

injection  operator  ,"V“)  such  that  the  closed  loop  semigroup 

,?  ^  (t)  £  o) )  generated  by  Q.  ♦  Ifl  £  :  TO  ♦  V-  is  exponentially  stable. 

T* 

(ii)  System  £  is  detectable  in  the  sense  that  there  exists  an  output 

injection  operator  T  ^  (  |RP  ,  ’V)T  )  such  that  the  closed  loop  semi¬ 
group  (10T*)  generated  by  *  Jf*  £T*:  V**  *  TO 

is  exponentially  stable. 

(iii)  For  every  1  f  iL  ,  tel  2  o, 


T* 


rank 


A  C  O 
C(eA) 


Note  that  (t)  6  (V)  satisfies  the  integral  equation. 

(6.15)  J^it)*  "  if  <*>♦  ♦  j  '^(t*s>  & 

for  every  t  i  o  and  every  $  ^zhj  (see  SALAMON  [40  >  Theorem  1.3.9]) 

and  hence  can  be  restricted  to  a  semigroup  on  if 

At  the  end  of  this  section  we  give  a  concrete  representation  of  the  output 
injection  semigroup  (t)  c  (*)  by  means  of  a  closed  loop  functional 

differential  equation.  For  this  sake  note  that  every  M6j?(Rp.3C) 
can  be  represented  as 

(6.16)  ]{y  -  (H^.H^Oy,  H2(-)y)*'*,  3  fc  \\? , 

where  Hq  6fcnXp,  H^-)  6  LZ(-h,ot  K2(-)  6,  L2(-h,o;  1£BXP). 

Moreover,  we  introduce  the  abbreviating  notation 

o 


Hj*62(t)  -  |  Hi(T-o)62(o)ds,  -h  $  r  $  o. 


for  i  -  1,2  and  ♦  (i  L  (-h,o;  J^) 
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I 


Theorem  6.7 


(i)  Let  x( • )  £  Lioc<-h»“;  i^.n  )  n  wioc^0,“;  satisfy  the  11706 

(6.17)  x(t)  -  L(xt+H1*yt)  +  B(ut+H2*yt)  ♦  Hoy(t) 


where  u(*)  <e  L^nr(-h,®;  tR,”)  and  y(‘)  4  Lioc^-h»“*  >RP)*  Then 


(6.18)  x(t)  -  (x(t),x£  H]*yt»ut  +  H2*yt>  €  »  t  i  o, 

ia  given  by  the  variation-of-constants  formula 

t  t 

(6.19)  x(t)  -  J  (t)x(o)  +  f  S  (t-s)  Q  u(s)ds  *  I  $  (t-s)$£  y(s)ds. 

Jo  >0 

)  *  w};*(o.-;  fe">  and 


(6 

.19) 

x(t) 

(ii) 

Let  x(' 

*)  t 

y(-) 

*  LLc<- 

-h,«; 

(6 

•20; 1) 

i(t) 

(6 

.20; 2) 

y(t) 

and 

let  x(t) 

a 

(6 

.21) 

x(t) 

loc 

T>P, 


» 


(t)x(o) 


Proof  In  order  to  prove  statement  (i),  let  ua  first  aasume  that  y(t)  ■  o 
for  t  i  o  and  define  z(t)  6  v(t)  6  (^B  for  t  i  -h  by 

z(t)  ■  x(t),  v(t)  ■  u(t)  for  t'  i  o  and 

o  o 

*(t)  -  x(x)  ♦  |  H1(T-o)y(o)do  ,  v(x)  -  u(t)  j  H2(r-o)y (o)do  , 


for  -h  S  t  f  o.  Then  it  ia  easy  to  see  that  x(t)  ■  (z(t),zt,v£)  for  all 


t  }  o  and  hence  the  following  equation  holds 
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«(t)  -  x(t) 


This  implies 


•  L(x  ♦H,*y  )  ♦  B(u  +H  *y  )  +  H  y(t) 
tit  t  l  c  o 


«  L  *t  +  Bv£  ,  t  i  o. 


c(t)  -  (*(t),zt,v£)  -  v/  (t)x(o)  +  Jj^t-s)  u(s)ds. 


Secondly,  let  u(t)  =  o  and  x(t)  ■  o,  y(T)  »  o  for  -h  i  t  s  o.  Moreover, 
let  Z(t)  C  ,  V(t)  fe  I^T*1**  e  s  ”**»  be  the  unique  solution  of 

Z(t)  *  LZ£  ♦  BV^  corresponding  to  the  input  V(t)  ■  0,  t  i  o,  and  the  initial 
condition  Z(o)  -  Ha  Z(t)  •  Hj(t),V(t)  «  H2(t),  -h  f  t  <  o.  Then 

(6.22)  (Z(t),Zt,Vc)  -  J3  (c)  6  ^  (  1KP.  '  1  4  °* 


Now  let  us  define 


z(t)  -  |  Z(t-s)y(s)ds  ,  z(t)  »  o, 
o 
t 

z(t,x)  -  I  Z(t-s+t)y (s)ds, 

Jo 

t 


'( t,x)  -  J  V(t-s+T)y(s)ds, 


for  t  i  o  and  -h  $  t  5  o.  Then  we  obtain 


(6.23) 


*(t,  •)  -  *t  ♦  Hj*yt  fe  ^  (~h,o;  [*.") 

V(t,-)  -  H2*yt  £  L2(-h,o;  R®) 


and  hence 
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*(t)  -  1  Z(t-s)y(s)ds  ♦  Z(o)y(t) 
h  t 

-  |  dn(T)  |  Z(c-S-T)y(s)ds 


♦  j  dS(T)  j  V (t-s-T )y (s)ds  ♦  Z(o)y(t) 


“  L(zt+Hi*yt)  +  B(H2*yt)  +  H0y(t) 

for  C  i  o.  This  implies  that  x(t)  -  z(t)  for  t  i  -h.  Thus  it  follows  f 
(6.22)  and  (6.23)  that 

i(t)  -  (x(t).xt  ♦  H1*yt,Hi*yt) 

-  («(t),z(t,.).v(t,-)) 

t 

-  (Z(t-s).Z  V  )y (s)ds 

Jq  l  s>  C"*S 

t 

'  J°  U~s)  $  y(»)4s. 

J  o 

This  proves  statement  (i) 

In  order  Co  prove  statement  (ii),  let  us  assume  that 

x(-)  L2  (-h.«;  &.")  A  W1*2  (0|*  \£n)  and  >•(•)  L2  (-h.-;  R?) 

ioc  loc  loc 

satisfy  (6.20)  and  that  x(t)  €  5^.  is  defined  by  (6.18)  with  u(*)  =  0. 

Moreover  suppose  that  *  -  x(o )*Ti  .  Then  y(t)  ,  t  5  o,  satisfies  the 

Volterra  integral  equation 


Jf(t)  -  C(xt  +  Hx*  yt) 


h  t 

|  dY(t)  d1  (t-x)  j  d  y(x)  x  (t-x) 


e  t 


|  [j  dlf(t)  (•“*)]  y(t-s)ds. 


t  i  o  , 


o  s 


12  P 

with  forcing  term  in  W  '  (0,  »j  J,).  This  implies  that 


loc 


y(‘>  fc  W**2  (o,  and  hence,  by  (i), 

loc 


x(t)  -  jf(t)  x(o)  +  Jjf(t-*)jfty(s)ds  «  ^  , 


for  every  c  i  o.  Moreover  it  follows  from  a  general  semigroup  theoretic 
result  that  x(t)  is  continuously  differentiable  in  X  and  satisfies 

£  i(t)  -  Ci  x(t)  ♦  *Ky(t)  -  (  a  •  .  j  = 

This  proves  (6.21)  for  the  case  x(o)  £  .  In  general  (6.21)  follows 

from  the  fact  that  both  sides  of  this  equation  depend  continuously  on  the 

T 

initial  functions  (x(o),x  ,y  )  £  ^6  of  (6.20).,  (for  existence  and  unique- 

O  O 

ness  results  for  this  type  of  equations  see  SALAMON  [40,  section  1.2}).  lZ3 
Finally,  note  that  the  transposed  equation  of  (6.20)  takes  the  form 
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(6.24; 1) 


£<t)  -  LTrt  ♦  CT  vt. 


h  t 


(6.24;2) 


'(t)  -  H**(t)  *  j  I  H*  (-s)dO|T(T)r(t+#-T)d8 
o  o 

h  t 

*  l  l  *(T)*(t+s-r)d« 

o  o 

h  t 

J  J  (-s)dYT(t) v(t-»s— r)ds  . 


o  o 

This  is  nothing  more  then  the  transposed  RFDE  (5.3)  with  a  control  low  which 
is  analogous  to  (6.12). 


6.3.  The  infinite  time  case 

In  this  subsection  we  consider  the  performance  index 

m 

(6.25)  J(u)  -  |  [||  y(t'  .  l?‘  ♦  uT  (t)  Ru(t)  ]dt 

o 

X*  mxm 

associated  with  the  Cauchy  problems  Z  and  Z  where  R  €  tR,  is  a 
positive  definite  matrix. 

Combining  the  results  of  section  3  (Theorem  3.3  and  Theorem  3. A) 
and  of  the  previous  subsection  (Theorem  6.5  and  Corollary  6.6)  we  obtain 
the  facts  which  are  sumnarised  in  the  theorem  below. 


Theorem  6.8 

(i)  If 

(6.26)  rank  [d(X),  B(e**j]  -  n  VX«£,  ReX  »  0, 

A 

then  there  exist  positive  semi-definite  operators  *  4  l.i'V  ,  D*)  and 
,\^T)  satisfying  the  algebraic  Riccati  equations. 
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r 

! 


(6.27)  w*  ♦  +%* 

respectively 


0 


(6.28)  {pf  +C£lft  *  $0j*£  -  f  £TV}BT  F  f  ^  ^*£  -  0 

(£4^^  ).  The  minimal  solutions  it  of  (6.27)  and  'ft  of  (6.28)  satisfy 

the  relation 


(6.29) 

(ii)  If  (6.26)  is  satisfied,  then  there  exists  a  unique  optimal  control 

u(*)  €:  (o,  «•;  tS.01)  which  minimizes  the  performance  index  (6.25) 

loc 

•ubject  to  (5.1),  (5.2).  This  optimal  control  is  given  by  the  feedback 
law 


u(t)  -  -  R  *  IT  X  (t) 

(6.30)  -  -  R_1fiT  (t) 

-  -  r-1/3t  IP  x  <0 


where  ir  respectively  V  is  the  minimal  solution  of  (6.27)  respectively  (6.28). 
The  optimal  cost  corresponding  to  the  initial  state  $  t  "X  is  given  by 

(6.31)  J(u)  -  <♦,*♦>■  <t,  ^f> 

where  f  •  ^  ^  is  the  initial  state  of  (5.5). 


-  94  - 


AD  -  A  f  39  333  THE  LINEAR  QUADRATIC  OPTIMAL  CONTROL  PROBLEM  FOR 

INFINITE  DIMENSIONAL  SYS. . (U)  WISCONSIN  UNIVMADISON 
MATHEMATICS  RESEARCH  CENTER  A  d  PRITCHARD  ET  AL . 
UNCLASSIFIED  JAN  84  NIRC-TSR-2624  DAAG29-80-C004 1  F/G  12/1 


MICROCOPY  RESOLUTION  TEST  CHART 

NAT  ION  Ai  F>U«IAU  O*  AM'-APP"  '.-f  •  A 


(iii)  If 


(6.32)  rank  |  ^  I  ■  n  VA  «  <£  ,  RaX  i  0,  Chan  tbs  algebraic 

I  C(aX*)j 

Riccati  aquation  (6.27)  raspaceivaly  (6.28)  hat  at  Boat  ona  aalf  adjoint, 
nonnagativa  solution  a  feiO),!}*)  raapactivaly  )p  t  ”&*) • 

Mora over,  if  a  raapactivaly  ^  ia  such  a  solution,  than  tha  closad  loop 
sanigroup  jf^t)  fe  %f  (V-) ,  ganaratad  by  CL  -£r”1/3  *a  raapactivaly 
jP**(t)  6  X  (*&T*)  ganaratad  by  CL**  -A***  i*  axponantially  stab  la. 

r 
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REMARKS  ON  THE  LITERATURE 

Th«  linear  quadratic  control  problem  for  RFDEa  with  undelayed 
i/o-variables  ha*  been  extensively  atudied  by  many  authors,  aee  e.g. 
KUSHNER-BARNEA  [30] ,  ALEKAL-BRUNOVSKY-CHYUNG-LEE  [  1  ] ,  CURTAIN  [  8 ] , 
DELFOUR-MITTER  [11],  MANITIUS  [36],  DELFOUR-McCALLA-MITTER  [13],  DELFOUR- 
LEE-MANITIUS  [14] ,  DELFOUR  [IS]  ,  BANKS- BURNS  [ 3 ] .  First  results  on  systems 
with  a  tingle  point  delay  in  the  state  and  control  variables  can  be  found 
in  KOIVO-LEE  [27],  KWDNG  [28]  and  some  further  ideas  in  this  direction  in 
ICHIKAWA  [22],  [23].  However,  an  avolution  equation  approach  to  this 
problem  has  only  recently  been  developed  by  VINTER  and  KWONG  [41]  for  HFDEs 
with  distributed  delays  in  the  control  variable.  This  approach  has  been 
generalised  to  RFDEs  with  general  delays  in  the  state-and-control  variables 
by  DELFOUR  [16],  [17],  [18].  Some  results  on  the  finite  time  linear  quadratic 

.  e 

control  problem  for  RFDEs  with  a  single  point  delay  in  state,  control  and 
observation  can  be  found  in  the  recent  paper  of  LEE  [33]  and  FERNANDEZ- 
BERDAGUER-LEE  [20].  However,  they  use  different  siethods  and  have  much  more 
res  tri  cti  ve  assisapt  ions . 

We  have  derived  the  solution  to  our  infinite  time  optimal  control  problem 

via  the  positive  semi-definite  solution  6  «£ ( ,0^  )  respectively 

•  fe  £tv  .V-*  of  the  algebraic  Riccati  equation  (6.28)  respectively  (6.27). 

Therefore  it  would  be  extremely  interesting  to  have  a  detailed  characterisation 

of  the  structure  of  the  operators  IP  and  *  which  arises  from  the  product  space 

structure  of  the  state  space.  In  the  case  of  RFDEs  with  state  delays  only 

such  a  characterisation  has  been  given  in  KWONG  [29] ;  VINTER- KWONG  [41]  for  the 

operator  and  in  DELFOUR  McCALLA -HITTER  [13]  for  the  operator  s  (note  that 

in  this  spacial  case  the  operators  If  and  s  may  be  definad  on  the  state  space 
2  n  2  n 

H  ■  (^  x  L  [-h,o;  ]  )•  An  analogous  resule  for  general  systems  of 

che  type  (5.1)  seems  to  be  unknown  since  the  Riccati  equations  (6.27)  and 
(6.28)  srs  apparently  new. 
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